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ABSTRACT 

Computerized adaptive testing (CAT) offers the 
opportunity to replace paper-and.-pencil aptitude tests such as the 
Armed Services Vocational Aptitude Battery with shorter , more 
accurate, and more secure computer-administered tests. Its potential 
advantages need to be verified hy experimental administration of 
automated tests to military recruit applicants whose subsequent 
training and job performance could be correlated with their CAT 
performance. A hardware and software system was developed for 
experimental administration of computerized aptitude tests to 
military personnel. A network of microprocessors was used, with each 
testing station including an Apple III personal computer. Eight such 
computers shared a 10 million byte Winchester disk containing the 
data base of items, programs, and examinee records. This report 
contains the system and user documentation. (Author/DWH) 
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FOREWORD 

\ joint-service coordinated effort is in progress to develop a computerized adaptive 
testinV (CAT) System and to evaluate its potential for use in the military entrance 
procefsiig statio'ns'lTa replacement for the A7med Services Vocational A pti^tude Ba^^^^^^^^^^ 
(ASVAB) printed tests. The Department of the Navy (Headquarters U-S. Marine Corps 
has be^ designated as lead service for CAT system development; and the Navy Personnel 
Research and^ Development Center, as lead laboratory. This effort is being conducted in 
support of project ZF63-521-030-101-0it.l2 (USMC Computerized Adaptive Testing). 

This report is the eighth in a series being issued under the CAT project. The first six 
reports described CAT system functional requirements and schedules, Fel'^jn^ry design 
considerations, the influence of fallible item parameters on adaptive testing the 
Relationship between corresponding ASVAB and CAT tests, a theoretical foundation or 
adap °ve administration of aptitude tests, and a screening test to be used at recruiting 
stations tJ predict ASVAB performance (NPRDC Tech. Note 82-22 and Tech ^^ps 82-52, 
83-15, 83-27, 83-32, and U-U). The seventh report provided a de^^L;^'"f ^^J?^ 

exper mental CAT hardware system and test administration procedures (NPRDC Tech 
Rep 8^-32). This report provides CAT system and tiser documentation, which is intended 
to acquaint users and programmers with the Navy Personnel Research and Developmen 
Center (NAVPERSRANDCEN) experimental CAT system. Much of the information is 
Technical describ-.^^^^ structure fUes, and program construction. A supp ement to this 
le^" whfch's ava'uabll upon request f'rom NAVPERSRANDCEN (Code 62), provides the 
complete Pascal program listings for the system. 

Results are intended for use by the professional community Department of Defense 
laboratories, and their contractors working on the development of CAT. 
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INTRODUCTION 

Problem 



ComDUteril-ed adaptive testing (CAT) offers the opportunity to replace the current 
J r^^-^i Armed Services Vocational Aptitude Battery (ASVAB) with shorter, more 
'accurate tn' o^rs^cure'co^^^^^^^ tests (McBride, 1979). The potential 

advantages of SaT o^er the cuVrent paper-and-pencil tests need to be verified before 
CAT cin £ alp oved for operational use in the enlistment testing program This 
verLcatL re^bi es experime^ administration of a battery of automated tests to 
military per3[ whose subsequent training and job performance can be tracked and 
correlated with their CAT test performance. 

Objective \ 

The obiectivl of this effort was to provide a hardware and software system suitable 
for exSer^me^tal ^ministration of various computerized aptitude tests to military recrui 
for .^''P^^'^^^^'jT. soecifications were modeled after the minimal requirements 

?SedTv Deiitt a^We i earlier CAT system developed at the University 

of Minnesota Unk^ CAT system, which was i^Pl^;:^^"^^^°" ^PPpt 

^LnrcomDUter the Navy Personnel Research and Development Center (NAVPERS- 
RrNDcSTcAT sy^^em had to be sufficiently portable so that it could be mov.d between 
murtarf se vTce inst^^^^^^^ every few months. At the same time, it had to Ix^ poweiful 
rnoueh to maintain a, data base of several thousand test items, including both text and 
3cs, to select a ^subset of test items appropriate to each examinee, to display the 
items rapidly, and to score the examinee's responses. 

Approach \ 

The aooroach was to use a network of microprocessors, or "personal computers," for 
tPStine Each testing station consisted of an Apple III personal computer containing its 
rjriogic, memory,' keyboard, and graphics display "P^^^'^'^^ ("^^^/f 
ronn- & Vicino 198it)\ Eight such computers were connected to a multiplexer 
^effaced w\ ^a ^o'mimdn-by^e Winchester disk containing the data base of test items 
programs, and examinee rd,cords. System reliability was maintained ^ ^'8%^-^^^^^ 
hiving reolacemert units on hand in case any single component failed Software 
^rarlsp'orta'bUity and modifi,ability were greatly facilitated by using the machine- 
independent structured programming language, UCSD Pascal. 

Results 

A highly reliable, portable, and modular system was developed and is in experimental 
use adaSively aSistering tc.sts similar to ASVAB in Navy, Marine Corps, Air Force, 
and' A?my training centers. ^Appendices A and B contain all of the user and programmer 
documenLion necessary for th'i operation and ^^f^^^^^^l^S^C,^ ^c'ot S 

to this report, which is avaUable upon request from N AVPERSRANDCEN ^Code b^i, 
provides the complete Pascal program listings for the CAT system. 
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GLOSSARY 



Bayesian 
CAT 

CATDATA 

CATPR03ECT 

codef ile 
CORVUS 



data file 

DEMO 

driver 
examinee 
file space 
fotofile 
GRAFIX 

gotoxy 
infotable 



U1 



fovalue 



Used in Bayesiar^ statistical estimation. The NAVPERSRANDCEN 
CAT s-stem uses Owen's (1975) Bayesian ^mation procedures to 
calculate ability and variance of estimates. It does not use Bayesian 
item selection; instead, information maximization is used. 

Computerized adaptive testing. 

Name of the file directory that contains the executable code files for • 
the CAT system. 

Name of this particular development project, also the name of the 
executable file of the program. 

Files that contain the P-code translation of a program. 

Peripheral hard disk storage device manufactured by Corvus Systems, 
Inc With a program called Constellation and a multiplexor, the 
Corvus is used to link up to eight Apple III microcomputers to its 
central hard disk storage. 

File containing data to be used by the program (e.g., the infotable). 
Format for these files is specified by the user. 

A demonstration program mode Available in Test Administration that 
prevents data from being written to the hard disk. 

A main program that is connected to and calls other slave programs. 
Person taking the CAT system test. 
Storage available in files. 

A file containing a computerized graphics picture. , 

Computer mode that sets the computer parameters for graphics 
programming. 

Pascal command directing cursor to a character location on the 
screen. 

Matrix table of 20 item IDs by 36 ability levels. This table is used in 
the test strategy to select the sequence of questions for the 
examinee. For a given ability level (row), the item IDs are listed in 
order of decreasing information. The first item ID is the one with 
the greatest information of all the items in the pool for that level. 

The value of the information function of a particular item at a 
particular ability level. Each question in the data base is assigned a 
value calculated from three probability parameters. The CAT system 
chooses several questions with the largest assigned values and from 
these randomly selects a question to administer an examinee. 




item block 

item code 

item pool 
itemptr 

key pad 

krunch 

LOGON 

PARAMS 

pixel 

QTEXT 

ret 

SPSSfile 

STOPFLAGS 

text file 
Theta 

Thunderclock 



Field in a record of linked list pointers in the question data base. 
This field specifies the block in an ASCII file in which text to a 
question is located. (See Appendix A, p. 28, for diagram.) \ 

Pointer field in the subtest directory record. Item coc'e indicates the 
location of a question's data and parameters in a separate file. (See 
Appendix A, p. 28, for diagram.) 

The complete list of questions for a subtest. 

' Pointer field in a record that specifies the location within a block of 
ASCII code where the text to a particular question is located. (See 
page A-29 for diagram.) 

Seventeen-key keyboard used by the examinee to interact with the 
CAT programs. 

Pascal command to eliminate empty space on a graphic screen. 
A program to gain access to the Corvus hard disk. 

Abbreviation of the word "parameters," used as a variable in the 
program. 

One of the "dots" that make up the graphics screen. The number of 
pixels per screen vary with the mode. 

Directory of files that contains the text of questions used by the CAT 
program. 

Return. 

A file of examinee test scores written at the completion of the 
testing session. It is called "SPSS" because it will be subjected to 
statistical analyses, although not necessarily those of the Statistical 
Package for Social Sciences (1983). / 

Variable name used in the Test Parameter Configuration program. If 
set to "yes" for a particular subtest, the testing sequence will be 
halted after the flagged subtest is completed. 

File that stores information such as computer programs, letters, and 
text. 

The ability level scale used in the implementation of a Bayesian 
strategy (Owen, 1975) for administering questions. There are 36 
levels, beginning with -2.25 and stepping up in increments of >-.125 to 
+ 2.125. 

Trademark for a clock made by Thunderware, Inc., and used by the 
Apple computer to track item response time. 
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APPENDIX A 
CAT SYSTliM DOCUMENTATION 



-Section 1--Features 

Section 2 — RequiremeriLS and Volume Contents 

Section 3--Program Descriptions 

Section ^f--System Structure 

Section 5--File Structure 



SECTION 1 
FEATURES 



Minimal Re q uirements for a CAT System 

According to Dewitt and Weiss (1974), the minimal requirement for any 
CAT system is the ability to perform the following functions: 

1. Select a test item from an item pool following a predetermined set of 
instructions. 

2. Present the item on a cathode ray tube or other display unit. 

3. Accept a response. 

4. Check response for validity and compatibUity with the instructional 
sequence. 

5. Determine whether the response is correct or incorrect. 

6. Calculate the response latency (time required to answer the question). 

7. Save the obtained data. 

8. Select the next item to be administered in accordance with a specified 
testing strategy. 

The NAVPERSRANDCEN CAT System . Initial Version fl.Oll 

In addition to the minimum requirements as described by Dewitt and 
Weiss (1974), the NAVPERSRANDCEN CAT system provides the following 
features : . . 

1 The system can be configured to give up to 20 subtests m any order, 
with any strategy, provided appropriate data structures exist for a particular 
strategy and subtest. 

2 The system is self-instructional and friendly. Examinees are presented 
with a computer familiarization session which they must pass according to a 
Tpecified criterion. If they cannot, the proctor is automatically called. Subtest 
instructions and sample questions are given if they exist m the data base. 

3 Each subtest can be configured to give up to 20 questions Also, each 
subtest has a flag that can be set to call the proctor at the conclusion of the 
subtest. Each subtest has a minimum variance that can be set to termmate the 
subtest when the examinee's variance matches or is less than this value. 

4 The system keeps track of how much time the examinee has spent in 
the computer familiarization sequence, in subtest instructions and samples on 
each subtest, and in the entire session. It also counts the proctor calls during 
a subtest and for the entire session. 

5. Examinees are allowed to change their answer at the time each ques- 
tion is presented. At this point, they also have the option of caUing the proc- 
tor by pressing the < HELP> key. 
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6 Feedback (scoring results) can be provided to examinees at three lev- 
els- (% iler a question, 0>) after a subtest, and (c) at the end of the session. 

7 Proctor options allow the examinee to continue with the session, exit 
the session and resume testing later, skip certain procedures or termmate the 
current subtest and begin the next subtest in the sequence An examinee who 
is S ?he middle of a s^test and desires to leave the session must answer the 
current question before the session wiU terminate. Upon return, the examinee 

r^ume at the sam. point. If a subtest is terminated to go on to the next 
one it is officially over and cannot be resumed. • 

8. Minimal data loss occurs upon power failure or other dj^st";, f 
loss to the system wiU result in all examinees losing data for the current sub- 
let When power is restored, examinees must log in again, whereopon they 
will be^n the subtest that was in progress when the power faded. Files are 
updated at the conclusion of each subtest. 

9. A demonstration mode is provided. When the log in routinj^^k for 
th*. ID number typing the word "demo" and then pressing the <YES> key 

put thT^st'e^in ?he demonstration mode. No data wiU be written to the 
disk , and session feedback cannot be given . 

10 A self-test mode is provided. Typing the word 'i^osf for the ID 
number will put the system in the self-test mode. TTie systeia wdl run 
ind"^niteTy taking subtests and answering questions without a., keyboard 
input. No data will be written to disk. 

11 A trace mode is provided. Typing the word 'trace' for the ID 
number will put the system in the trace mode. Then all system trace messages 
put in by the programmer will appear. 

12. Data are stored in Pascal data files. They are readily interpretable and 
easily accessible. At the end of an examinee's session, data are wntten out to 
a text file for analysis by SPSS (1983). 

13 Up to 21 item pools can be created. Each item pool is a subtest that 
mav contain a bank of 295 questions and 5 sample questions. ,^11 items in the 
Tubte^ instructions, sampks. and questions are readily displayed, modified. 
Tntlred.Tr deleted. Data can be modified. Questions may be presented as 

graphics. , 

14 Test data banks can be listed to screen, file, or printer for 
verification. Text and data, or data only can be listed as output. 

15. System security is provided. Examinees cannot log into the system 
unless the proctor has given prior authorization. 

16 New strategies can easily be integrated into the system. The program 
is modular and minimal modifications are necessary. 

17. Graphics capability is provided. A graphics editor allows creation of 
graphics questions. 

18 Examinee data-base management is provided by a program that 
allows one to look at. enter, modify, or delete examinee records. 
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19 Flexibility of test administration is provided. The testing parameters 
file is easily modified through a program to give various configurations. 

20 Strategy data-base management is provided to allow viewing enter- 
ing, ^d modifying of data in strategy data structures and to identify the ques- 
tions actually used in the strategy. 

21. Overall system friendliness is provided by simple menus and instruc- 
tional prompting given by the computer^ 

Changes Introduced in the ^rnnd Version [1.021 

1 On the last screen shown to an examinee in a speeded test, times are 
set to zero for unfinished items in the examinee's file. 

2 System log-in by the proctor in Examinee Data Base Management 
allows multiple examinee log-ins without return to the main menu. 

3 Routines are added to analyze the item sequencing specified by the 
-infotable' (see glossary). For example, by listing the items that are used in the 
tabirand those Aat7e not. items that wQl never be used in the current stra- 
tegy may be ^entmed. Thii kind of analysis helps the system designer elim- 
inate unused items from the pool. 

4 Additional elements are added to the examinee personal data record. 
Verification of certain data is required when the examinee resumes inter- 
^^p"ed es"ing While the old data structure was restricted to Navy school 
codes aid foLats. the new data structure allows for testing Marines and- 
membe^ of the other armed services. Test Administration now asks for 
"or'ect date before sessions are given; this information is saved in the exam- 

inee files. . . . u n 

5 The Apple III computer has a type-ahead buffer, which <^ould ^"0^ 
examinees to type the answers to questions before they are Presented. The 
nIvpFRS^NDCEN cat system includes a keyboard flush-ahead to 
prtvenf ex'^il^^^ doing L. THe keyboard 

timc^ tests to allow examinees to answer questions on a multiple-question 
^Teen before the entire screen has appeared. Thus, the examinees can 
Tesp^nd at their maximum speed, without waiting for the computer. 

6. The first version ol the CAT keybo^d included ^21^]^"^^%^^ 
allow examinees to edit their responses to ^^^^'^^^P^"!! 'I^;^ 
free-resDonse tests were never used. The new version of CAT removes expla 
natton aC prlctl^e in the use of the erase key from the Test Administration s 
computer familiarization. , u .1, 

7. The limits for times tests are modified to allow specification of both 

minutes and seconds. •,• 1 

8 To reduce the likelihood of examinees receiving the same initial 
sequence of "ems. items are selected at random from a pool of the best items. 
Three randomization strategies are available: 
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a The (5 4 32 1) strategy selects at random the first item from 
the best five, the second item from the best unused four, and so 
forth. 

b. The (10 8 6 4 2) strategy selects the first item at random from 
the best ten, and the fifth to last items at random from the best two 
unused items. 

c. The (10 2 2 2 2) strategy selects the second to last items at 
random from the best two unused items (see section ^). 

Chances Introduced in the Third V ersion ri.031 

1 New system diagnostic procedures are added. The program will 
check infotables to verify that items in the infotable are actually in the 
item pool and that no items arc marked as used at the beginnmg of a test, 
iw wUl check all subtest questions to sec that if the graphics Bag is set, 
there is a graphics file on the volume: it wiU also check a subtest for 
duplicate or similar questions. 

2 Graphics compresssion is implemented. Most files of graphic 
screen images have been reduced from 32 blocks to 4. Compressed files 
that require less than 5 seconds to be displayed replace the ^-block 
-fotofiles- (see glossary). The graphics editor has been revised to allow for 
compression and is more friendly, displaying a menu of options. 

3 Documentation of the CAT system is avaUable on Une to users on 
their Apple lU monitors. A CAT system with the documentation files 
requires a 20-megabyte disk drive. 

Changes Introduced in the Four th Version fl.04l 

1 A routine is added that checks the infotable for dupUcate entries. 
This routine is incorporated into the verify option of the Infotable 
Manager program. If a duplicate is found, an error message will appear 
along with the duplicated infotable locations. 

2 The program will delay writing an examinee's test results to the 
hard disk until a proctor has entered a password and continued the pro- 
gram. This will prevent damage to files due to simultaneous writing to 
the same disk file by several examinees. 

Changes Introduced in the Fifth Version [1.05] 

1 The Ghost self-test routine has been modified to simulate a 
predesignated ability level. There are now three options available: an 
idiot ghost that randomly guesses on all items (the original Ghost rou- 
tine) a specified ability-level ghost, and a program loop ghost that exer- 
cises ability levels \0 through +3.0 by stepping up in intervals of +1 with 
each completion of a test session. 
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2 For each examinee, predicted scores are calculated that estimate 
the scores the examinee would have received on a paper-and-pencil 
ASVAB test This information is included in the examinee test results 
file The predicted ASVAB score is calculated for only five subtests: 
word knowledge, mechanical comprehension, paragraph comprehension, 
general science, and arithmetic reasoning. 
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SECTION! 

REQUIREMENTS AND VOLUME CONTENTS [IMS] 

This section describes the hardware and software required to use the 
CAT system version [11)5], including the Apple IH computer, Corvus system, 
and the contents of the Corvus volumes. 

Ai>t>le m 

CAT system [lJ05] is designed to run on an Apple HI microcomputer with 
data access to m Corvus hard disk (model llAP) having at least 10 megabytes 
of storage. The Apple IH must have at least 256 K bytes of memoryavailable 
and be equipped with « THUNDERCLOCK PLUS (sec glossary). The moni- 
tor for the computer must be capable of 40- and 80-column displays. 

Corvus 

The Corvus disk storage unit can be linked to as many as eight Apple HI 
computers by a Corvus multiplexer. Backups of the CAT program can be 
made using a feature of the Corvus system called the Mirror. The Mirror pro- 
gram copies the contents of specified Corvus volumes to a videotape. The 
Turrent implementation of the CAT program uses a separate videotape 
recorder for creating backups. 

The Corvus disk must have a minimum of 10 megabytes of storage, 
configured in the following way: 

1. Volumes necessary for the CAT system arc : 

a. 'CSl.' This volume contains the necessary Pascal operating system 
code files. 

b "CATDATA." This volume contains the code files of the CAT sys- 
tem and all data bases, for the subtests, examinees, configuration files, 
and strategy data. 

c. 'QTEXT.' This volume contains the text of all questions in the 
CAT system. 

d. "CATFOTO." This volume contains all the graphic questions in 
subdirectories. 

e. TFILES.' This volume contains all the program text files for the 
CAT system. 

2. Volumes a through d must be mounted for access on the Corvus in 
order to execute the CAT system. 

3. All volumes are Apple Ul SOS formatted. 

4. The contents of the Corvus volumes b through e are described on the 
following pages. 
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Volume : CATDATA 



Size : 4504 Blocks 



File 



Description 



CATPICJOTO 

TESTINDEX X> ATA 

PARAMETERSX)ATA 

TABINFODATA 

ITEMPOOLDATA 

EINDEXJDATA 

EPDATADATA 

EINFODATA 

ERESULTSX)ATA 

DONERSLTSX)ATA 

DONEEPDX>ATA 

DONEDIRDATA 

DONEINFOX>ATA 

CATDATEX)ATA 

CATPROJECT.CODE 

ADMIN. CODE 

PMGR.CODE 

TJ4GR.CODE 

EJ^GR.CODE 

SMGR.CODE 

GJVIGR.CODE 

DMGR.CODE 



Session header introduction 

Subtest directories 

Subtests configuration file 

Infotables for Bayesian strategy 

Subtest data, parameters, flags, pointers 

Examinee data base directory 

Examinee personal data 

Examinee testing data (not test results) 

Examinee testing results 

Done examinee testing results 

Done examinee personal data 

Done examinee data base directory 

Done examinee testing data (not test results) 

Data file that contains current CAT date 

CAT system driver code file 

Test administration code file 

Parameters configuration code file 

Test data base management code file 

Examinee data base management code file 

Strategy data base management code file 

Graphics management code file 

Cat system diagnostic program code file 



Volume : QTEXT Size : 2048 Blocks 

File Description 

ITEMTEXTX>ATA Text for all questions in data base 
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Volume : CATFOTO 



Size : 10880 Blocks 



This volume contains subdirectories for each subtest in the data base. AM 
fotofiles for a subtest are saved in a designated subdirectory. Programs wiU 
automatically decide where to save or load a fotofile and automatically give it 
A designated file name. 



File 



ADIR 

BDIR 

CDIR 

DDIR 

EDIR 

FDIR 

GDIR 

HDIR 

IDIR 

JDIR 

KDIR 

LDIR 

MDIK 

NDIR 

ODIR 

PDIR 

QDIR 

RDIR 

SDIR 

TDIR 

UDIR 



Description 



Subdirectories of 
fotofiles and 
compressed 
graphics. 



Subtest 



Word Knowledge 
General Science 
Arithmetic Reasoning 
Math Knowledge 
Paragraph Comprehension 
Numerical Operations 
PC2 

Auto Information 
Mechanical Comprehension 
Electronic Information 
Coding Speed II 
Numerical Operations II 
Numerical Operations in 
Numerical Operations IV 
Coding Speed III 
Coding Speed IV 
MK2 

Shop Information 

MC2 

AR2 

EI2 
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Volume : TFILES Size : 2048 Blocks 

All text files for the CAT project are located on this volume. 



File 



CATPROJECT.TEXT 

ADMIN X)IR 

ADMIN.TEXT 
ADEC.TEXT 
A.IUTL.TEXT 
A2UTL.TEXT 



Description 

CAT system driver textfile 



Subdirectory-test administration text files 
Test administration driver 
Declarations for test administration 
Utilities 
Utilities 
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A£SUMM.TEXT 

AJO.TEXT 

AJ»ROCT.TEXi 

A.CF.TEXT 

AiOGlN 

A.Gl.TEXT 

AJNITE.TEXT 

AiOADT.TEXT 

A.QUEST.TEXT 

A.UABIL.TEXT 

APBACK.TEXT 

PMGRJDIR 

PJVlGR.TEXT 

P.UTL.TEXT 
P.VffiW.TEXT 
P5P.TEXT 
PPBACK.TEXT 

TMGRX)IR 

TJVIGR.TEXT 

T.IUTL.TEXT 

T.SUBRT.TEXT 

T.ISUBRT.TEXT 

TJO.TEXT 

T.GETl.TEXT 

T.GET2.TEXT 

TJNSTR.TEXT 

T.SAMPLES.TEXT 

TilST.TEXT 

TJ4EW.TEXT 

TDELETE.TEXT 

TPLOPPY.TEXT 

TSEARCH.TEXT 



Write examinee data to text file at end of session 

I/O routines 

Proctor routine 

Computer familiarization 

Log in examinee 

General instructions 

Initialize examinee subtest record before test 

Load a subtest to administer 

Select a question to administer 

Update the examinee's ability and variance 

Give feedback to the examinee 

Subdirectory-parameter management text files 
Driver to set up system parameters 
Utilities 

Look at testing parameters 
Configure testing parameters 
Configure feedback parameters 

Subdirectory-test manager text files 
Tcsc manager driver 
Utilities 

Utilities-subroutines 

Utilities-subroutines 

I/O routines 

Fetch subtest part 1 

Fetch subtest part 2 

Manage subtest instructions 

Manage sample questions for subtest 

List subtests in data base 

Create a new subtest 

Delete a subtest 

Write subtest to floppy 

Search for duplicate questions 



EMGRJDIR 

EJ^GR.TEXT 
E.UTL.TEXT 
ESUBRT.TEXT 
E JO .TEXT 
EiOGIN.TEXT 
EJETCH.TEXT 
E5TATUS.TEXT 
EX)ELETE.TEXT 
E£NDOFDAY.TEXT 
ESUMMARY.TEXT 
E.ZERO.TEXT 



Subdirectory-examinee manager text files 
Examinee manager driver 
Utilities 

Utilities-subroutines 
I/O routines 

Log in examinees, allow access to system 
Get examinee to put in personal data 
Display status of all examinees in system 
Delete an examinee from data base 
Separate completed examinees 
Write examinee data to text file for SPSS 
Zero out examinee data base 
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SMGRX>IR 

SJVIGR.TEXT 

S.UTL.TEXT 

SJ4EWTEXT 

S.VERF.TEXT 

SJ40DF.TEXT 

SilST.TEXT 

SPn«).TEXT 

SANALYZE.TEXT 

GMGRX)IR 

GJ^GR.TEXT 

G.UTL.TEXT 

G5UBRT.TEXT 

G.ISUBRT.TEXT 

G2SUBRT.TEXT 

DMGRX)IR 

DMGR.TEXT 

D.UTL.TEXT 

D5EARCH.TEXT 

DJNFOTAB.TEXT 

D.GRAFIX.TEXT 

UMGRX>IR 

UMGR.TEXT 



Subdirectory-strategy manager text files 
Strategy manager driver 
UtUities 

Make iiev infotable 
Verify infotable 
Modify infotable 
List infotable 
Queries into infotable 
Analysis on infotable values 

Subdirectory-graphics management 
Graphics editor driver 
UtUities 

Main menu graphics procedures 
Compression routines to krunch graphics 
More compression routines 

Subdirectory-CAT diagnostic program 
Diagnostic driver 
UtUities 

Searches a subtest for duplicate questions 

Checks validity of irsfotables. 

Checks to see whether graphics files exist 

Subdirectory-user documentation text files 
User documentation driver 



MISCX)IR 

CATFFORMAT.TEXT 
CATKRUNCH.TEXT 



Subdirectory-miscellaneous text files 
Formats new files i!:or system 
Will krunch the question text file 



Volume : DOC 



Size : 2048 Blocks 



This volume contains the documentation text files that are accessed by the 
User Documentation program. 
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SECTION 3 
PROGRAM DESCRIPTIONS 



CAT system. These programs, which are all 

related 



Seven programs make up the CAT system. Th 
ted through the files they access, arc as follows: 



Test Administration 

This program gives the examinees a computer orientation sequence and 
then administers a sequence of subtests as specified by a control file Ques- 
tions are selected by adaptive testing strategies (Owen, 1975) and data on 
examinee sessions are recorded and saved. The main modules of the program 
are : 

1. Proctor routines. 

2. Computer familiarization. 

3. General instructions. 

4. Log in procedures. 

5. Examinee pretest initialization. 

6. Loading subtest and strategy. 

7. Administering a question. 

8. Updating the examinee ability level. 

9. Feedback routines. 

The program basicaUy controls the flow of execution through these 
modules. Files are updated after every subtest, so that if power loss or some 
interruption occurs, causing the system to crash, all examinees will be able to 
log on again and resume the subtest they were on at the beginning. The fol- 
lowing three major loops in the program exist: 

1. Giving continuous sessions. 

2. Giving a sequence of subtests. 

3. Giving a sequence of questions. 

ConfiEure Test Parameters 

The Configure Test Paiameters program allows the testing parameters to 
be set up. This program is run at the beginning of the testing day. and it does 
the following : 

1. Allows any combination of subtests, up to 20 from a pool of 21. 

2. Allows the selected subtests to be given in any order. 
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3. Allows 1 to 20 questions to be given per subtest. 

4. Allows any subtest to be given with any available strategy if a stra- 
tegy data structure exists for the subtest. 

5 Allows each subtest to have a lower limit on the variance of the 
estimated ability. The subtest will automatically terminate when this 
lower limit is reached. 

6 Allows temporary delay after each subtest, if needed. This delay 
halts the session untU the proctor starts up the examinee again. 

7 Allows examinee feedback parameters to be specified. A detailed or 
simple summary can be displayed or printed using question, subtest, 
or session feedback. 

8. Allows for verification of the system parameters by writing the data 
to a printer or screen. 

A file contains all the information necessary to accomplish these func- 
tions. Whenever a change is made in the parameters, the file is updated. 

Current infotable strategies include : 

B102222- Randomly selects from the 10 best questions in a specified row 
for the first question, and randomly from the next 2 beat questions for every 
question thereafter. 

B5432I- For question 1, randomly selects from 5 best questions; for ques- 
tion 2, randomly selects from 4 best questions; for question 3, selects from 3 
best questions; for question 2. selects 2 best questions; and for every question 
thereafter, selects the best question for a specific row. 

B108642: For question 1, randomly selects from 10 best questions; for 
question 2. randomly selects from 8 best questions; for question 3. randomly 
selects from 6 best questions; for question 4, randomly selects from 4 best 
questions; and for every question thereafter, selects the 2 best questions for a 
specific row. 



Test Manager 

The CAT Test Manager program maintains a data base of up to 21 sub- 
tests and their respective item pools. The program can do the followmg : 

1. Create a new subtest if there is room, and then insert questions into 
that subtest. 

2. List all the subtests in the main directory to see which subtests exist 
and how many questions are in each one. 
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3. Remove a subtest from the data base. 

4. Change the name of any subtest, and specify whether the subtest 
requires a 40 or 80 column format, using the first character of the subtest 
name The second character of the name can be used to specify the cutoff 
time, in minutes, of a timed subtest. The third and fourth character are used 
to specify the seconds. 

5. Transfer a subtest from the Cor\-us files onto a floppy disk for moving 
data. A recovery program is needed to restore the original format to use the 
floppy data with the Test Administration Program. 

6. Access a subtest for any of the following reasons : 

a. To insert a question, its text, code number, and associated data. 

b. To delete a question from the subtest. 

c. To insert, modify, delete, or look at the instructions for the sub- 
test. 

d. To insert, modify, delete, or look at up to five subtest sample 
questions for the subtest. 

e. To modify the text, code number, or any data associated with a 
question. 

f. To set a graphics flag that signals that the item has a graphics pic- 
ture associated with it, normi^^or compressed. 

The program accomplishes all these functions through a hierarchical 
structure of options and the use of three files: (1) the tests directory, which 
contains all subtests and their respective directories, (2) the file that contains 
all the data for each question of any subtest, and (3) the file that contams 
ASCU and special program codes to display question text. These three files 
are used by the CAT Test Administration program to display questions and 
use question data for strategy algorithms. 

Special Programming Notes 

1. Slot 0 of a subtest directory is reserved for the subtest instructions. If 
the code number for this slot is greater than or equal to 0, then the subtest 
instructions exist. 

2. Slots 1 to 5 of a subtest directory are reserved for the subtest sample 
questions. If the code number in any of these slots is greater than or equal to 
zero, then the sample question exists in that slot. 

3. Various types of answers are stored, due to the different types of sub- 
tests. The program can store the correct answer to a question as a character, 
an integer, or an array of seven characters. 

4. The first character of the subtest name specifies the screen format for 
that subtest. sets the screen to 80 columns inverse, '@' sets the screen to 80 
columns normal, and '?' sets the screen to 40 columns normal. If none of 
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these are the first character of the subtest name, then the screen wUl default 
to 40 columns inverse. The second, third, and fourth characters of the subtest 
name are used to specify the allotted time for speeded tests. The second char- 
acter is used to specify minutes, while the third and fourth are used for 
seconds. , 

Examinee Data Manager 

The CAT Examinee Data Manager maintains and provides access to a 
data base of up to 50 examinees. The following functions are described: 

1. -ENTER EXAMINEE PERSONAL DATA' aUcws proctors to enter 
changes, or look at the examinee personal data. 

2. 'VIEW EXAMINEE RECORDS' displays to the screen, printer, or 
file a brief summary of the examinee performance on the subtests, as well as 
the time spent in each subtest and for the~entire session. 

3. -REMOVE EXAMINEE' removes an examinee from the directory in 
the data base. 

4. TURGE DIRECTORY' clears out and initializes the entire directory 
to empty (no examinees in system). 

5. -LOG EXAMINEE INTO SYSTEM' allocates file space for an exam- 
inee and, by doing so, allows the examinee to take the subtests in the Test 
Administration program. No examinee can take subtests without first being 
entered into the system through this procedure. When the examinee logs mto 
the Test Administration program, his pr her ID number is checked to see if it 
exists in the system. If it docs, the examinee can continue. 

6. 'SEPARATE DONE/NOT DONE EXAMINEES' searches through the 
files for all examinees who have completed their testing sessions and writes 
these examinees out to a separate file. This file has an identical record for- 
mat, so that any procedure to access the original file can also access the 
'finished' examinees. It also writes a summary of each examinee to a text file 
on the volume CATDATA, with the followiilg file name: "E,' concatenated 
with the examinee's social security number. 

7. 'SELECT FILES TO MANAGE' sets the file needed, cither the files 
in which examinees' names are originally entered (session files), or the files 
that also contain the names of the finished examinees (done-cxammee files). 

8. -LIST DIRECTORY' lists the status of the examinees in the directory 
wheii^er they are new, finished, or partially completed with the subtests. 

Strategy Data Manager 

The CAT Strategy Data Manager program provides maintenance and 
access to the data structures necessary for computerized adaptive testing. Its 
basic functions are to provide a means for entering data mto the data 



A-14 



26 



structures, modifying the data in the data, and listing the data to the console, 
a printer, or a file for verification. Data structures are maintained as informa- 
tion tables using a matrix of 36 rows by 20 columns. 



Graphics Editor 

This program allows you to construct graphics for the subtest questions 
that require them. Sixteen K of memory must be allocated for graphics to run 
this program. After you specify the subtest you wish to work with, you are 
put into the graphics editor with the foUowing options: 



F)ast cursor: 
S)low cursor: 

D) raw: 

E) rase: 
K)runch: 

C)haracters: 

I.)ine: 

Q)uit: 
H)ome: 

R)ead: 

P)olygon: 

N)ew: 
W)rite: 



Sets flag to move pixel cursor to eight times as fast. 

Sets pixel cursor to normal speed. 

Sets flag so keypad numbers will plot points. 

Sets flag so keypad numbers will erase points. 

Will compress whatever is on the graphics screen to 
a data file of points and lines. 

Enters character mode. Any key pressed will be dis- 
played on the screen. Press <ESCAPE> to leave this 
mode. 

Draws a line between last plotted point and current 
position. 

Exits editor and returns to main menu. 

Positions cursor at the lower left-hand side of drawing 
screen. 

Reads and load^ a graphics picture (fotofile or com- 
pressed graphics). A four-digit item code or specif ed 
name is requested. 

Draws a polygon. The number of sides and the size 
are requested. Enter even integer numbers for sides. 

Clears entire viewport. 

Saves whatever is displayed on the screen. Writes it to 
a file. A four-digit item code or specified file name is 
required. 
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< up arrow> : 

< down arrow> 
left arrow > : 
1..9: 



Moves position up one pixel. 

Moves position down one pixel. 

Moves position left one pixel. 

Pressing these keys on the numeric keypad 
will plot a point or erase a point in these 
respective directions : l.SW; 2,S; 3,SE; 4,W; 
5 current position, 6,E; 7,NW; 8,N; 9,NE. 



Diagnostic Progam 



This program allows you to verify system stability by checking infotables, 
graphic questions, and subl A questions. The foUowing options are available : 

CHECK INFOTABLES: This procedure loads the infotable for each sub- 
test and checks each item code entry to sec whether it exists in the subtest 
directory. If not, the location where the error occurred is saved and the 
errors Usted. For the timed tests, or where no infotable is necessary, the error 
count will normally be 760 errors. 

CHECK GRAPHICS: This procedure checks each question for each sub- 
test. If the graphics or compres«?d graphics flag is set, then the procedure wdl 
attempt to locate the appropriate file on the volume CATFOTO in the 
appropriate subdirectory. If it cannot locate the file, then it records the item 
code and lists the errors. 

DUPLICATE QUESTION SEARCHES: This procedure takes two pieces 
of information supplied by the user and searches a subtest for duplicate ques- 
Hons The user suppUes the number of keywords, up to 20, that wUl be taken 
from'a question to be matched. The user also suppUcs a minimum cntenon; 
tha°is. the minimum number of matches that will be acceptable tojdentify 
the two questions as similar. The minimum criterion can be up to 20 words. 
The user does not enter the actual words, but the number of words to be corn- 
oared The program searches the text of a specified subtest and gets the 
Lecified number of the longest words in the question. It then compares these 
words with other words of other questions. If the minimum critenon number 
of words match, then it records that question pair as similar. Output is a list 
of similar questions. 
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SECTION 4 
SYSTEM STRUCTURE 



The CAT system structure is divided into seven primary programs and a 
supplementry user documentation program, each with special characteristics 
,ha, are no.ed below and described in ""^f J^Pf "^"/a,^^^ 
through 9). The programs access a common data base of CAT Data rues. 
The following diagram shows how the programs fit together: 



CAT PROJECT STRUCTURE 



I User I 
iDocuBentationl 



Conf igure 
Test 
Peraneters 




CAT 
Data 
Ft lea 



I SystcB I 

IDIagnoQticel 



I I 

I Test I 

-1 Data Basa | 

I rianageaentj 



Strategy 
Data Base 
tlanagement 



Graph i co 
Edi tor 



Exaainee 

Data Base 
tlanags""* 



Test Administration (ADMIN) 

This is the prototype schema for administering a sequence of subtests to 
each examinee, based on adaptive strategies, and then saving the results, the 
following figures illustrate the Test Administration program structures. 
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TEST ADniNISTRATION STRXTURE 
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TEST AOniNISTRATlON HIERARCHY 



AdainiBter teste 



Give test battery 



Computer 
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Ci ve quest i on 
block 



Subtest 
feedback 



Strategy 
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Update 
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Quest i on 
feedback 



CAT Test Administration Modules 

Controll er (ADNUN). This module reads in the test configuration vectors 
and ^trols the flow through all the modules. It calls general instructions, 
logs in examinees, gives sessions of subtests, and provides feedback. 

Genera l Instructions (A.CF & A.GI), This module familiarizes the exam- 
inee "^ilh the computer keyboard and gives general instructions on how to 
take the tests. 

Log In Exam inee (Ai.OGI^0. This module gets examinee personal data 
and verifies entry to the system, ft sets flags and counters to handle new or 
returning examinees. 

I nitialize Examinee (A.INITE). This module sets up an examinee test 
resufls record to handle new and returning examinees. It also restores 
configuration vectors assigned to specific examinees. 
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I^ad Subtest (AXOADT). This module loads the subtest directory of 
items and the strategy data structure. It gives subtest instructions and sam- 
ples. 

Administer Question (A.QUEST). This module selects a question based 
on strategy and examinee abiUty level (if required), displays the question, gets 
examinee response, and updates the results record. It wUl never give the same 
question twice to an examinee. It also selects the two alternative items to 
administer next: the one the examinee will receive for answering correctly, 
and the other for answering incorrectly. 

Feedback (Af BACK). This module sends feedback on a question, sub- 
test, or session level to the console or printer. 

Update Ability fA.UABIL). This module takes the examinee's current 
ability estimate and the new ability estimate and its variance, using the A, B, 
and C parameters of the question last answered. 

Proctor Call (AJROCT). This module provides external control through 
the other modules. The proctor is called by the examinee w^n Jhe computer 
senses keying errors or when the examinee presses the <HELP> key. Itie 
proctor can then allow the examinee to continue 

Configure Test Param eters ( P.MGR) 

This program allows users to change the default test configuration vec- 
tors It allows tailoring of subtest strategies, order, length, and so on. 
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T^ct nata Base Management (TJvlGR) 

This program manages the data base of subtests and their respective item 
pools. It allows creation of new subtests, insertion of items, and editing for 
text and data. 
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Examinee Data Base Management (E>MGR) 

This program allows access to all parts of the examinee data, the personal 
data, and test results. It pennits statistical and psychological interpretation of 
data. 



EHAniNEE DATA BASE HIERARCHY 
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StratcRv Data Base Management (SAiGR ) 

Many strategies involve data structures that define the selection of ques- 
tions. This program permits manipulation and management of the data. 
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INFOTABLE MANAGER HIERARCHY 
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I 

Find 
i teas in 
1 nf otable 



Anal yzo 
va luee 



Graphics Ed itor (GJ4GR) 

This program allows creation and modification of pictures for items that 
require them Graphics are stored as fotofiles or as compressed data files. 



GRAPHICS EDITOR STRUCTURE 



I Subtest I 
I di rectory | 



I 
I 

Enter g-aphiC8 
for which 
subtest 
I 
I 

(Get record njmber) 

I 
I 



I Graphics editor I 

^^^^^ Apple 111 Pgraf unit 

I 

I 

Kead/urile to 
fclofile or coirp-essed graphice 
I 
I 
I 



I Col led ion of I 

I folof 1 lee I 

I and csfpressed | 

I data g-aphicB I 
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CAT System Diagnos ticg fD34GR) 

This program checki the vaUdity of data in certain files; namely, 
infotables, graphics, and ASCII text. 



CAT SYSTEn DIAGNOSTICS HIERARCHY 



Oi agnostic tlanagor 
I 



cJ,n,o,»,. c.„J,.jK.c. is^!:^,^"-" 

vaiu»« questions 



User E)ocumentation (U3iGR) 

This program provides the user with access to documentation text files 
that are kept on the Corvus disk. 



USER DOCUrtNTATION PROGRAfl 



Docu»entat ion tlaragsr 

I 
I 



I 
I 

sinois'pao- «ho"l.' c.iaTofl. to th.-consoU 



Print a Print ths Di splay a paa* 
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SECTIONS 
FILE STRUCTURE 



This section outlines the five file structures used in the CAT system 
subtest data base, subtest configuration, examinee data base strategy data, and 
Etaphics files. The structures will be detailed in the following pages. The 
diagram below shows how the structures relate to the program discussed m 
the previous section. 

CAT PROJECT FILE AND PROGRATl ?«>nONSH^PS 
jTeet Data Bae» ftanaowntj 



Sgstea 

Diagnostics 



I Configure Test! 
Paraaaters I 



Subtaat Data Basa 



I Subtest 
IDlrectorg 





1 hlTm 1 


1 1 oiti 1 





Strategy 
Data Base 
rtanageaant 



I 



I Subtest I 1 Teat Ad»inietration| — 

I Conf igugation | ~ 



Graphics |— j Graphics j 
Editor I I Files 1 ^ 

/ 

/ 

T 



Strategy Data 
llnfotablel 



I 



User 
Docuaentation 



Exaainee 
Data Base 
Manageaent 



Exaalnee Data Basa 



Seasion 
Exaalnaa 


Coapleted 
Exaainae 


IPereonal I 
1 Data 1 


1 Personal 1 
1 Data 1 




iDirectorgI 


IDirectorgI 


1 Test- 1 

1 taking | 
1 Info 1 


1 Test- 1 
taking j 
Info 1 




1 Subteet | 
1 Results 1 


1 Subtest 1 
1 Results 1 



Note. Files are d-;signated by double outlines; programs by bold lines. 
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Subtest Data Base 

The subtest data base uses three file structures in the following manner : 

1 The directory file contains records of subtest directories. The subtest 
directory record contains a linear Ust of item codes for that test The location 
of the item code in the Ust is used as a key in a °»>PP"»«/""^i'°° 
specifies the location of the question data in the second file. A field for the 
subtest name is checked for the desired subtest directory. T\« 'J.^J^^" 
linear list of item codes U reserved for subtest instructions. Slots 1 through 5 
are reserved for sample questions. Through the subtest name, the screen 
piaLeters are specified (i..., inverse/40 columns). If it is a tuned subtest 
three digits in the subtest name specify the cut-off tune ui minutes and 
seconds. 

2 The item data file contains records that store all data and parameters 
for each item. Two important fields are the itemblock and itemptr. These 
t^inters specify the location of the question text in the thud^ file. Itemblock 
Reifies the block in which the text begins and itemptr specifies the location 
within the block, the byte at which the question begins. 

3 The item text file contains nothing but ASCII codes, byte counts, and 
other codes necessary for manipulating the question text. The first four bytes 
^" reserved for pointers to the end of the file so that text for new items or 
modifications may be inserted there. Special codes are : 

128- This flag -signals the occurrence of a gotoxy cursor movement. 
Whe^ihis code is read, the program identifies the next two bytes as the 
x-coordinate and y-coordinates to move to. The next byte after the x and 
V bytes is a count of the number of characters on this particular Ime. 
This enables mass movement of bytes to write the line out to the screen. 

129- This flag signals that the question continues on another screen 
imag^ us allowing the program to prompt the user to press a key to 
continue reading the question. 

130- This flag marks unused space in the ASCU file when a question 
is deirtid or changed. The old text is marked as unused for possible gar- 
bage collection later. 

131: This flag marks the end of the text for f-is item. 
Layouts of the records contained in these three files are provided on 
pages A-27 through A-29. j 
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La yo"^ Sub te st Directory File 



(• test directory *) 

DIRDATA = PACKED RECORD ^ 

(• true ===> this record not occupied ) 
UNUSED : BOOLEAN; 

(• name of subtest *) 
TESTNAME : STRING; 

(• directory of pool of questions in subtest ') 
ITEMCODE : PACKED ARRAY 
[0..MAXITEMPOOL1 
OF INTEGER; (* question code # *) 

END; 



I ayniit of Item D ata File 

(• question ptrs/data , information for each question *) 
ITEMDATA = PACKED RECORD 

(• flags if graphics item *) 

GRAPHICS : BOOLEAN; 

(• valid response ranges for multiple choice *) 

LOWANSWER, 

HIGHANSWER : CHAR; 

(• block # in file where text starts *) 
ITEMBLOCK, 

(• byte # in block where text starts *) 
ITEMPTR, 

(• # of answers if multi;,Je quesuon screen *) 
ANSWERCOUNT rlNTHGER; 

(• information parameters bayesian strategy *) 
A.B.C, 

(• currently ur a ed *) 

PROPCORREt. J. 

POINTBISER^AL, 

YOPT, 

XOPT, 

■ DUMMYl, (• if compressed graphics, = 10 *) 
DUMMY2, 
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DUMMY3 : REAL; 

(• correct answer to question *) 

CASE ATYPE : ITEMRESPONSES OF 

CHARVALUE : (ANSWER : CHAR); 

INTVALUE : (INTANSWER : INTEGER); 

SEVENCHR : (CHRANSWER : SEVENTYPE); 

END; 



FILE STRXTURE x SUBTEST DATA BASE 



(Mapping function) 
Subtest directory > Question data & 



RECORD e 



testnaBc 

unused x 
\ teracods 
\ tencode \\ 
i tettcode [23 



i tewcode TN] 



RECORD 1 



teotname : 
unused : 
i temcode [03 
i temcode W\ 



I temcode (N3 



\/\/\/\/\/\/\/ 



\/\/\/\/\/\/\/! 

----I 

RECORD I 
-I 

I 



First 4 bgtas uoed to 
storii pointers to froo 
bicck t l>uts 



j Question taxt 

(ASCII I control 
nuabers) 




RECORD e 



louaneuer x 
hi ghaoBuer: 

itenblock: » 

itemptr: * 

ansuer: 

a»b,c parameters 
& other data: 



RECORD 1 



I ouansuer: 

X 

2 

& other data : 



RECORD 2 



/\/\/\/\/\/\/\/\ 



/\/\/\/\/\/\/\/\ 



RECORD (N*l) » < 



BLOCK B 



•I 



ASCII i 
control flags 



BLOOC 1 



/\/\/\/\/\/\/ 



/\/\/\/\/\/\/| 
: 
i 
s 
z 

z ' 



File Qrous 
as long as 
quest ions 
added or 
»odi f t ed. 
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4 i-< • 



Biock B 



Layout of I te« Text F:le 



free block # free byte tf 



/ 

1B7 
116 

97 

S8 
103 

97 

4B 

52 
128 
121 
114 
128 
102 

lie 

97 
11 
10S 
52 
121 
184 
181 
115 
111 

58 
188 
111 

32 
138 
117 
181 
115 
117 

32 
G 
118 
117 

77 
115 
189 

46 
184 

11 

99 



\ 
1 

121 
114 
128 
184 
121 
32 
4B 
8 
32 
188 
B 
45 
IIB 
114 
51 
IIB 
4B 
131 
181 
97 
5S 
111 
4B 
128 
118 
115 
138 
114 
97 
58 
118 
188 
11 
181 
115 
97 
IIB 
181 
32 
128 
1B3 
51 
116 



/ 
2 
32 
108 
B 
128 
108 
32 
32 
4 

109 
121 
7 
103 
128 
108 

4B 
117 

32 
128 
100 
114 
128 
115 

32 

101 

liS 
130 
110 
114 
12B 
117 
97 
51 
128 
112 
103 
32 
97 
32 
B 
103 
4B 
128 



\ 
0 

109 
121 
7 
B 
105 
115 
32 
65 
111 
32 
49 
111 
6 
105 
32 
116 
32 
0 
32 
108 
6 
101 
32 
11 
160 
111 
138 
32 
108 
£ 

112 
121 
46 

B 
101 
110 
110 
110 
100 

9 
101 
32 

6 



128 
111 

32 

7S 
9 

107 
111 
108 
117 
115 
109 
46 
118 
9 

109 
32 
105 
104 
4 

109 

12) 

7 

110 
103 
51 
128 
112 
131 
109 
121 
7 

128 
98 
32 
13 
99 
10S 
101 
115 
10S 
50 
114 
32 
13 



e 

115 
189 

46 

50 
101 
102 
101 
116 
116 
101 

32 
101 

50 
101 

99 
111 

las 

67 

111 

32 



4 

116 
101 
32 
46 
128 



15 
32 
97 
32 
32 
6 



116 123 

118 101 

111 110 

32 110 

97 110 

32 115 

114 'ell0 
46 32 

110 116 

111 110 
110 128 

115 116 
108 117 
115 




101 
114 
46 
6 
112 
128 
111 
32 
49 
6 
114 
32 
52 
116 
102 
97 
58 
109 
46 
97 
114 
52 



100 

97 
32 
13 
101 . 

e 

115 
109 

46 
9 
101 
103 

46 
131 
121 
114 
128 
10S 

32 
116 
101 

46 



32 
128 
115 
32 
52 
100 
4 

116 

101 
32 
50 
97 

114 
32 

128 
32 

108 
6 

lie 

32 

lei 

102 

32 



97 
32 
6 
112 
115 
46 
131 
77 
32 
97 
32 
4P 

ie7 

10S 
32 
0 

109 
121 
7 

105 

lei 

128 
108 

32 



111 
110 
110 
115 
32 
128 
101 
115 
4 
111 
32 
49 
115 
120 
6 
101 
114 



end of text flag - 131 
gotoxg flag " 128 




M location, 
g location. 



byte count are the 
3 coneccutive by tee 
after gotoxy flag 



unused " 130 
' aec i i " 32 . • 126 
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Subtest Configuration 



The subtest configuration file contains the default configuration vectors 
for test administration. This file contains information on feedback parame- 
terSy appropriate strategies, appropriate length for subtests, and choice of sub- 
tests to give. It is set up by a configuration program: 



Record contains 

all of the 
items listed at 



record 0 



(• set-up parameters •) 
SETUPINFO = PACKED RECORD 

flags # tests in sequence, > 20 - no subtest 



SUBORDER, 



the left 



(• strategy setup •) 



SUBSTRAT : PACKED ARRAY[1..GMAXSUBTEST] 
OF 0..128; 

question feedback code ^) 
ITEMFB, 

question feedback output code ^) 
ITEMOUTPUT, 

subtest feedback cx)de 
SUBTESTFB, 

subtest feedback destination cede 
SUBTESTOUTPUT, 

session feedback code 
SESSIONFB, 



session feedback destination; screen/printer 
SESSIONOUTPUT : 0..128; 

(• subtest stop flag *) 

SUBSTOP : PACKED ARRAY[1..GMAXSUBTEST] 
OF BOOLEAN; 

(• subtest length •) 

SUBLENGTH : PACKED ARRAY[1..GMAXSUBTEST] 
OF 0..128; 



EKLC 



4^ 

A-30 



(• variance check *) 

CKERROR : ARRAY[1..GMAXSUBTEST1 OF REAL; 



END; 

Examinee Data Base 

The data base for the examinee records includes four types of files: 
examinee personal data, directory, test-taking information, and subtest results. 
Two sets of these files exist: (1) the "session' files that are updated as exam- 
inees are taking the test, (2) identical files that contain information only for 
completed examinees. When the procedure for separating completed exam- 
inees from the others is run in EMGR, the session files are searched. Any 
examinees who have completed their session are removed from the session 
files and transferred to the "done" files. 

1. The personal data file contains information such as the examinee's 
name, address, social security number, state, and marital status. 

2. The examinee directory is a linear list of an identification key and a 
flag indicating that the slot in the directory is occupied. A searcL for an 
examinee consists of stepping through the directory looking for the matching 
ID key. The slot in which it was found specifies the record number of the 
second file in which personal data are found and is also used as a key in a sim- 
ple hash function to return the number of the examinee's first subtest results 
record. The next 19 records are the 2nd through 20th subtest results. For 
example, any examinee who was located in directory slot 4 would have per- 
sonal records in record 4 of the personal data file and test results in records (4 
• 20) = 80 through 99 of the subtest results file. The hash function consists of 
simply multiplying the slot number by 20. 

3. The test-taking information file contains records of the test 
configuration vectors assigned to each examinee, the length of time the exam- 
inee spent in the session, the time he or she spent in computer orientation, 
and other test-related data. 

4. The subtest results file accommodates a maximum of 20 subtests with a 
maximum of 20 questions per test. Relevant data stored include the number 
of questions taken, number correct, response, ability, variance, time latency, 
and so on. Layouts of examinee data base records are presented below. 



Layout of Personal Data Record 

(• examinee personal d'ata *) 
PINFOREC = RECORD 

LASTNAME : PACKED ARRAY[0..14] OF CHAR; 

FIRSTNAME : PACKED ARRAY[0..11] OF CHAR; 
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MINITIAL : CHAR; 
CURRADDRESS, 

HOMEOFREC : PACKED ARRAY[0..1] OF CHAR; 
CITIZENSHIP : PACKED ARRAY[0.3] OF CHAR; 
SEX : CHAR; 

POPGROUP : PACKED ARRAY[0..4] OF CHAR; 
ETHNIC : PACKED ARRAY OF CHAR; 
MARITAL : CHAR; 

DEPENDANTS : PACKED ARRAY[0..1] OF CHAR; 
BIRTHDATE : PACKED ARRAY[0..7] OF CHAR; 
EDUCATION : PACKED ARRAY[0.2] OF CHAR; 
TESTID : PACKED ARRAY[0.2] OF CHAR; 
AFQT : PACKED ARRAY[0..1] OF CHAR; 
ASVAB : PACKED ARRAY[0..43] OF CHAR; 
ENLISTDATE, 

ACTSERDATE : PACKED ARRAY[0..7] OF CHAR; 
ENL : PACKED ARRAY[0..4] OF CHAR; 
AFEES : PACKED ARRAY[0..1] OF CHAR; 
BOS : PACKED ARRAY[0..1] OF CHAR; 
POSTASVAB : PACKED ARRAY[0..43] OF CHAR; 
STESTORDER : PACKED ARRAY[0.59] OF CHAR; 

END; 



I^a yout of Directory Record 
(• examinee directory *) 

INDEX = PACKED ARRAY[O.MAXEXAMINEE] 
OF PACKED RECORD 

(• true ==> record available *) 
UNUSED : BOOLEAN; 

(• social security/id key *) 
ID : IDTYPE; 

END; 



Layout of Test-taking Informatio n Record 

(• examinee test taking data *) 
EXAMEINFO = PACKED RECORD 

(• social security # *) 

ID : IDTYPE; 
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(• time spent in computer orientation •) 



ORIENTATIONTIME, 

(• timed test, last time session was interrupted *) 
PREVTIMELASTTEST, 

(• number of proctor calls *) 
NUMPROC, 

(• total time spent at computer *) 
TOTTIMECONSOLE , 

(• number of key in errors *) 
NUMERRORS, 

(• # of last test taken - 1, eg.- if on test 5 •) 
(• then this variable holds a value of 4.*) 
LASTTEST INTEGER; 

(• date of log in *) 

DATE : PACKED ARRAY[0.5] OF CHAR; 
(• time at log in *) 

TIME : PACKED ARRAY[0.3] OF CHAR; 

(• testing configuration given to this examinee •) 
(• record # of subtest directories *) 
TESTORDER, 

(• adaptive strategy *) 
STRATEGY, 

(• # of questions per test *) 

TESTLENGTH : PACKED ARRAY[1..GMAXSUBTEST1 



(• predicted asvab scores paper/pencil test •) 
PREDASVAB, 

(• initial variance for each test *) 

CKERROR : ARRAY[1..GMAXSUBTEST] OF REAL; 



OF 0..128; 




..GMAXSUBTEST] OF BOOLEAN 



END; 
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Layout of Subtest Results Record 

(• question scores , data on examinee with respect to question *) 
ITEM = PACKED RECORD 

(• keeps track of correct answers for multiple question *) 

(• screens. *) 
ACORRECT : PACKED ARRAY[0..6] OF BOOLEAN; 

(• number of questions per screen *) 
ACOUNT, 

(• which question he took, code # *) 
ITEMNUM : INTEGER; 

(• true ==> answered it correctly *) 
CORRECT : BOOLEAN; 

(• ability after answering this question *) 
THETA, 

(• variance after answering this q\iestion *) 
ERROR, 

(* time spent answering this question *) 
LATENCY :REAL; 

(• how he answered the question *) 
CASE RTYPE : ITEMRESPONSES OF 

CHARVALUE : (RESPONSE : CHAR); 

INTVALUE : (INTRESPONSE : INTEGER); 

SEVENCHR : (CHRRESPONSE : SEVENTYPE); 

END; 



(• test scores of examinee results *) 
SUBTEST = PACKED RECORD 

(• time in seconds taken for subtest *) 
STTIME, 

(• number of seconds spent in subtest instructions *) 
STINSTRTIME, 

(• number of proctor calls during subtest •) 
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STPROCTCALLS, 

(• number oi keying errors during subtest *) 
STERRKEY : INTEGER; 

(• number of questions he answered *) 
NUMITEMS, 

(* # of correct responses *) 
NUMCORR : 0.128; 

(• final estimate of ability *) 
ESTABILITY, 

(* final variance of ability *) 
VARIANCE : REAL; 

(• results on question level *) 

ITEMINFO : PACKED ARRAYIO. QUESTIONS] OF ITEM; 



END; 



FILE STRUCTURE i EXAHINEF ..mTA BASE 



(One to one correapondencu) 
E.a.inee directonu ---> J^.a-.nee^.ata^ ^^^^ 



RECORD 0 



exanii nee 


id : 


unused : 




exdm \ nee 


id : 


|unu9ed : 




1 I 




1 X 









\/\/\/\/\/\/\/ 



I RECORD 8 



IRECOK Pj 



->|na«e,BCK, i--->|cj>nf iCJi-e 
Ipereonal f. |vec^or«. | 
|data,s>U I Meat m o 



IRtCG.iO 2 I 

I — { 

I RECORD d I 

I— 

I ; 1 

|/\/\/\/v./! 



jNth exarcinee: 
I unused: 



RECORD (N-1) 

I H 

.) RECORD N 1- 



5 

!Pf J 21 
i RECORD 3 1 



) t I 
|/V\|\/\| 



\ 

c?CCORO(N-l) 

->1REC0RD N| 
i 



Subtest reoulta 



RECORD 8 



queationa 
\ff correct* 
etc. 



RECORD 1 



i 



1 



jrocorda 8-19 
I for exaainee 
(m a lot 8 



RECORD 19 



j r ecorda 28-39 
I for e^am I nee 
I fn alot 1 of 
jdi rectorg. 



j RECORD (N+l)«28 
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Strategy Data 



An "infotable'^ is a table of item numbers sorted by information for each 
of a number of ability levels. The CAT system currently uses infotables with 
36 rows of ability levels and 20 columns of items. The ability levels vary from 
'2250 to +2.125 in steps of 0.125 on the theta scale. For example, the 10th row 
in the infotable corresponds to an ability of -1250. The first column contains 
the item ID number of the item with the greatest information for that ability 
level, the second column contains the number of the item with the second 
greatest information for that ability, and so forth. 

The data file record is declared as a matrix of 20 columns by 36 rows of 
integers (array[l.^,1.36]). Each record contains one table, and tables are 
loaded into a program variable. The program knows which table to load 
because there is a one-to-one correspondence of the number of the infotables 
and the number of subtests allowed in the directory. If a test is loaded from 
directory record 0, then record 0 in the infotable file contains the infotable 
for that subtest. The infotable is not loaded from that record, however, 
because there are two infotables for each subtest. Infotables in records 0 
through N contain the item code number as an entry in the table, while 
records N+1 through 2N+1 contain the directory index for the item. The 
second set of records are set* up whenever an infotable is verified in the infot- 
able manager. This is the record that the Test Administration program uses 
because it has directions about the location of the item and does not need to 
search the directory. 



I 

I record 

I 



, / /\/\/\/\/\/\/\/\/\/\/\/\ 

./\/\/ >'\/\/\/\/\/\/\/\/\/\ 

\ I 



I* v-'c. jrd 



k+1 



' record 

I : 
I : 

\/\/\/\/\/\/\/\/\/\/\\/\//\ 

\\/\/\/\/\/\//\/\/\/\/\/\// 

I 

I 

I record 2k + 1 



20 column bg 36 rou 
■atr'iM of i.itegerB 



There are K Bubttet elote in 
di rec tory 



Records 8 to k have infotablea 
u i th i temcodee 



Records k+1 to 2k + 1 have infotables 
uith directory slot locations 



TNFQTABLE MAPPING OF ABTLITY TO ROW 



Row 



Range (ability) 



Midpoint 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 



-231250 .. 
-2.18750 . 
-2.06250 . 
-1.93750 . 
-1.81250 . 
-1.68750 . 
-1.56250 . 
-1.43750 . 
-131250 . 
-1.18750 
-1.06250 
-0.93750 
-0.81250 
-0.68750 
-0^250 
-0.43750 
-031250 
-0.18750 
-0.06250 
0.06250 
0.18750 
031250 
0.43750 
0.56250 
0.68750 
0.81250 
0.93750 
1.06250 
1 18750 
131250 
1.43750 
1.56250 
1.68750 
1.81250 
1.93750 
2.06250 



-2.18751 
-2.06251 
-1.93751 
-1.81251 
-1.68751 
-1^251 
-1.43751 
-131251 
-1.18751 
-1.06251 
-0.93751 
-0.81251 
-0.68751 
, -036251 
-0.43751 
, -031251 
, -0.18751 
. -0.06251 
. 0.06249 
. 0.18749 
. 031249 
. 0.43749 
. 036249 
. 0.68749 
. 0.81249 
. 0.93749 
. J. 06249 
. 1.18749 
,. 131249 
. 1.43749 
. 136249 
.. 1.68749 
.. 1.81249 
.. 1.93749 
.. 2.06249 
.. 2.18749 



-225000 
-2.12500 
-2.00000 
-1.87500 
-1.75000 
-1.62500 
-130000 
-137500 
-125000 
-1.12500 
-1.00000 
-0.87500 
-0.75000 
-0.62500 
-030000 
-037500 
-025000 
-0.12500 
0.0 

0.12500 

025000 

037500 

030000 

0.62500 

0.75000 

0.87500 

1.00000 

1.12500 

125000 

137500 

130000 

1.62500 

1.75000 

1.87500 

2.00000 

2.12500 
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Graphics Files 



The Graphics Manager saves the screen image with a built-in procedure 
in the Pgraf unit. Each screen image occupies 32 blocks of disk storage, called 
a "fotofile." The user does not have to specify the filename, which is com- 
puted by the following method: 

Fotofile name is the letter "G" concatenated with the character of the 
ASCn value 65 + the subtest record number (this yields a character from A - 
Z), concatenated with the letter "Q," concatenated with the item code 
number, concatenated with "ioto 

Example- If the subtrst occupies record 2, and the item code is 1103, then 
the fotofile nkme is GBQ1103ioto. The 'G' stands for graphics, the 'B' desig- 
nates the subtest, "Q* stands for question, 1103 designates the question, and 
"ioto" designates a graphics screen image. The fotofile name is written out to 
a subdirectory on volume CATFOTO, based on the graphics code and subtest 
record number. 

Compressed Graphics Structure 

The graphics compression program is designed to run on the Apple UI 
with 16K of memory allocated for graphics. The mode of graphics is black 
and white, 560 by 192 pixels. The procedure allows users to compress the 
standard 32-block fotofile into data files using considerably less space. A pro- 
cedure to decode these compressed files confirms the state of the compressed 
picture and compares the display time with that used by the Pgraf routine 
GLOAD The data file is unformatted. Information is read from it in incre- 
ments of four blocks into a buffer of type integers or bytes. The file names 
for the compressed graphics are calculated in the same way as fotofiles, except 
that "Cr is not used for question. File names are written out to the appropri- 
ate subdirectory in a similar way. 

Graphics Compression Algorithm 

L The contents of the graphics screen arc read into two array buffers. 
Buffer 1 always reflects the state of the original screen. Buffer 2 reflects what 
is left to compress after each phase of compression. 

2 Compression occurs in five phases: Buffer 1 is first scanned in the X- 
direction Buffer 1 is scanned in the Y-direction, Buffer 2 is scanned in the 
ascending and descending diagonal directions, and Buffer 2 is scanned for any 
remaining dojs. Finally, ASCII codes are added to the file for characters. 
These phases are described in further detaU below: 

Phase 1: Buffer 1 is scanned in a horizontal fashion searching for 
lines greater than one pixel length. If a line is found, the following infor- 
mation is saved : X location, Y location, and a line length. Buffer 2 is 
updated to reflect what has been compressed. 
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Ph ase 2- Buffer 1 is scanned in a vertical fashion searching for lines 
gi..at^MWonc pixel length. If a line is found, the two buffers are com- 
paied to find any dots already set by Phase 1. The beginning and end of 
the line are adjusted if the extreme ends have been previously set. Then 
the dots internal to the line are checked. The ratio of dots previously 
compressed to those not compressed are checked. The line wil be 
compressed if the ratio meets a certain value. Otherwise, the line will be 
compressed in the later phases. The ratio is currently biased toward 
drawing lines. The information saved is: X location. Y location, and a line 
length. Buffer 2 is updated. 

P hase 3- Buffer 2 is scanned to search for diagonal lines. If a diago- 
nal line greater than length 2 is found, then the following information is 
saved: x location 1. X location 2. Y location 2. Buffer 2 is updated. 

Phase 4: Buffer 2 is scanned for any remaining dots, and the X loca- 
tion and Y location are saved. 

Phase 5: The user enters characters into the graphics picture, and 
these characters are saved in a buffer representing the screen. Then they 
are written out to the same file as thrgraphics data, with the information 
in length of bytes. The ASCII values are written out similarly to the data 
for normal text questions (See subtest file structures for more detail..)- 

Compressed Graphics D isplay Aleorithm 

1 Display of a compressed graphics picture also occurs in five pfiases. 
Four blocks from the compressed data file are read into a buffer, and informa- 
tion is extracted sequentially through it. 

Phase 1- This phase draws horizontal lines. X - location. Y - location, 
and Tu^^TTength (dot count) are expected. A MOVETO(X.Y) is exe- 
cuted, followed by a LINEREL (linelength.Y). Data are continually 
fetched until the X location is negative, which signals the end of Phase 1. 

Phase 2- This phase draws vertical lines, x - location. Y - location, 
and Tuiiriength (dot count) arc expected. A MOVETO(X.Y) is exe- 
cuted, and followed by a LINEREL (X.linelength). Data are fetched 
again and the instructions executed untU the X - location is negative, sig- 
naling the end of Phase 2. 

Phase 3: This phase draws diagonal lines. XI - 1^^^°"' ]f ^ :J°"^,\°'}' 
X2 - location, and Y2 - location are extracted. A MOVETO(Xl.Yl) is 
performed, followed by LINETO(X2.Y2). Data are fetched again and the 
instructions executed until the X - location is negative, signalmg the end 
of Phase 3. 

Phase 4- This phase draws dots, extracting the X - location, and Y - 
location A DOTAT(X,Y) is performed, data are fetched again. a.nd the 
instructions executed until the X - location is negative. This point signals 
the end of Phase 4 and the graphics decoding of the compressed picture. 

Phase 5: The ASCII characters arfc written out to the graphics screen. 
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A goto flag moves the cursor to the appropriate location, and then the 
ASCU are written byte by byte. An end-of-text flag (131) signals the end 
of the file. At this point the complete picture is displayed. 



r.PAPHIC FILES OVERVIEW 



SUBTEST 
Word Knowledge 
General Science 
Arithmetic Reasoning 
Mathematics Knowledge 
Paragraph Comprehension 
Numerical Operations 
PC2 

Automotive Information 
Mechanical Comprehension 
Electronics Information 
Coding Speed II 
Numerical Operations II 
Numerical Operations III 
Numerical Operations IV 
Coding Speed III 
Coding Speed IV 
MK2 

Shop Information 
MC2 
AR2 
EI2 



GRAPHICS 




RECORD N 


CODE 


SUBDIRECTORY 


A 


ADIR 


0 


B 


BDIR 


1 


C 


CDIR 


2 


D 


DDIR 


3 


E 


EDIR 


4 


F 


FDIR 


5 


G 


GDIR 


6 


H 


HDIR 


7 


I I 


IDIR 


8 


J 


JDIR 


9 


K 


KDIR 


10 


L 


LDIR 


11 


M 


MDIR 


12 


N 


NDIR 


13 


O 


ODIR 


14 


P 


PDIR 


15 


Q 


QDIR 


16 


R 


RDIR 


17 


S 


- SDIR 


18 


T 


TDIR 


19 


U 


UDIR 


20 
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CAT USER DOCUMENTATION 



SfKTtion 1 --Bringing up the CAT System - B-1 

Section 2--Test Administration Program B-3 

Section 3--Configure Test Parameters Program B-8 

Section ^f--Test Data Base Management Program B-16 

Section 5--Examinee Data Base Management Program B-36 

Section 6--Strategy Data Base Management Program 

Section 7-- Graphics Editor Program - B-56 

Section 8 - -System Diagnostics Program B-63 

Section 9--User Documentation Program B-67 

Section 10--Graphics Information 

Section 1 1 —Miscellaneous Associated Programs B-SO 



This manual assumes that the user has some knowledge of the Corvus system, such as how 
to boot and mount volumes. It also assumes the user has some knowledge of the Pascal 
operation system, such as how to execute Pascal code files. 
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SECTION 1 
BRINGING UP THE CAT SYSTEM 



In order to use the CAT system, the three volumes listed below must be 
mounted on the Apple UI's disk system (usually a Corvus 10 megabyte hard 
disk). These three volumes contain the necessary code and data files. 

CATDATA: Program code files and data files to access the various sub- 
tests and their questions and datafiles for results of testing; 4000 blocks 
minimum. 

CATFOTO: Graphic questions with 32 blocks per question for foto, 4 
blocks for compressed graphics. 

QTEXT: Text for questions; size depends on the questions in the sub- 
tests. Typically up to 600 blocks or mons. 

The Apple UI computer must have 256K of RAM, a clock, and 16K of 
memofy allocated for the graphics buffer. Begin by exec^sting the following 
program: '/CATDATA/CATPROJECT.CODE' 

This code file manages all of the major parts in the CAT system. The fol- 
lowing menu will appear: 



CAT PROJECT MENU [105] 
Select one of the following programs by entering its number. 

1. QUIT 

2. TEST ADMINISTRATION 

3. CONFIGURE TEST PARAMETERS 

4. TEST DATABASE MANAGEMENT 

5. EXAMINEE DATABASE MANAGEMENT 

6. STRATEGY DATABASE MANAGEMENT 

7. GRAPHICS EDITOR 

8. CAT SYSTEM DIAGNOSTICS 

9. ON-LINE USER DOCUMENTATION 

Enter choice # : 



Each of the numbered items constitutes a separate code file. Access a pro- 
gram by typing its number from the menu or by executing the code file 
directly from the Pascal command line. 

54 

B-l 



Each of these code file* U on the volume CATDATA. The code 
names corresponding to each program arc: 



TEST ADMINISTRATION ^Z^CoSr 

CONFIGURE TEST PARAMETERS x m?r COdI 

TEST DATABASE MANAGEMENT ^ I wr R CODE 

EXAMINEE DATABASE MANAGEMENT f Jfr r COdI 

STRATEGY DATATBASE MANAGEMENT 5,^° « rnnF 

GRAPHICS EDITOR n mgS CODE 

CAT SYSTEM DIAGNOSTICS fr wr 5 CODE 

ON-LINE USER DOCMENTATION UMGR.CODE 

The programs are described in sections 2 through 9. 
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SFdTON 2 
lEST AD'^aWISTRATION PROGRAM 
(MENU 0'»'nON 2) 

Test administration require?^ a test proctor first to check that certain 
requirements are lulfiUed. Then i^c examinee is guided through a familiariza- 
tion sequence and expected to enter a social security number to log on to the 
system. The examinee is xhen given a serisis of subtests, and the results are 
saved automatically on disk. 

There are four important things to check before running the Test 
Administration program: 

1. Make sure enough file space is allocated to cover the examinees to be 
tested, using the Examinee Data Base Management program (see section 5). 

2 Testing parameters should be checked for the proper subtest sequence 
and appropriate strategies, using the Configure Test Parameter program (see 
section 3). 

3. Feec'back parameters must be checked to be certain that the Apples 
are interfaced correctly with the printer (see section 3). 

4. The alpha-lock key on the Apple must be pressed down so that all 
keys are entered as capitals. 

To begin administering the program, execute V CATD AT A/CAT- 
PROJECT. CODE'. The menu screen wiil be uisplayed. Choose option 2 
(Test Administration) from the menu. The program will return with the date. 
If a change is desired, the year, month, and day must all be changed, or eise 
the date will appear with the unkeyed portions deleted. 



CAT SYSTEM DATE IS 3/31/83 

DO YOU WISH TO CHANGE THE DATE ? 

PRESS < YES> OR < NO> : 



Once the date is set correctly and <NO> is pressed, the screen will 
display the CAT logo. Pressing the <YES> key now will begin the test 
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session. 

The examinee will be guided through a series of computer familiarization 
and genera] instruction screens. This segment gives the examinee a little time 
to become acquainted with the keyboard. _ 

The entire Test Administration sequence is designed to be self-teaching, 
requiring little supervision for the examinees. The following documention 
describes actions for any unusual problems that may interrupt the sequence of 
testing. 

KEYBOARD CONFIGURATION 













I'i' 




Ti' 




Ti 




iT 


e 


1 


ERASE 






YES 



The alphabetic and numeric keys on the keyboard are used for answering 
the subtest questions. The <YES> and <NO> keys confirm the examinee 
response and allow a second chance to answer. The <ERASE> key allows 
the examinee to change a key entry, while the < HELP> key will call the 
proctor. 

While the program guides the examinee through the familiarization 
module, it will restate a question that is answered incorrectly. If the exarn- 
inee makes more than three keying errors during any practice exercise, or if 
the <HELP> key is pressed, the proctor will be called. At this point the 
screen v ill display the message, PLEASE CALL THE PROCTOR, and will 
not respond further until a special password is entered. 

To continue the program and bring up the proctor menu, press the 
<YES> key to clear the buffer of any keys that the examinee may have 
pressed. Then 

1. Enter the password "CAD' if using a modified keyboard, or "LJ;" if 
using the normal keyboard. Press the < YES> key. 

The program should prcmpt the user v ith: 'PASSWORD f. If this does 
not appear, make sure the alpha-lock key is pressed, and then repeat step one. 



2 Now enter the password "CI" if using the modified keyboard, or 'LI" if 
using the normal keyboard. A proctor menu should be displayed on the 
screen If not, repeat step two of the password sequence. The procter menu 
display will vaiy depending on the module the call was made from. There are 
siTpossible options for the proctor menu. Since it is impractical to illustrate 
each menu, the options wUl be described below: 

1 RETURN TO TESTING PROCEDURES. Allows the examinee to 
continue with the Test Administration program as if the proctor had never 
been called. 

2. EXIT GENERAL INSTRUCTIONS. Allows the examinee to skip the 
rest of the familiarization sequence and continue to the general instructions. 
If fhe examinee is in the general instructions sequence, then the program wiU 
allow a branch to the log-on routine. 

3 EXIT LOGON/CONTINUE. If this option is chosen before the exam- 
inee has entered a social security number, the session will terminate for the 
examinee and a new session will begin. 

4 EXIT SUBTEST INSTRUCTIONS/SAMPLES. This option allows the 
examinee to skip the subtest instructions and go on to the subtest sample 
questions, or skip the samples and go on to the actual testing. 

5 GO ON TO NEXT SUBTEST. Allows the examinee to leave the 
current subtest and go on to the next one. The examinee cannot go back to 
the subtest from which the proctor was called. 

6 GO ON TO NEXT SESSION. Allows the examinee to leave the ses- 
sion and return to testing at some later time. If the present question has not 
been completed, the examinee must give an answer. When the exammee 
returns to the session, he or she wUl be returned to the same subtest left and 
resume testing as if no interruption had occurred. The subtest time and the 
total session time may be altered or incorrect. Instructions and samples are 
repeated. 

A proctor menu screen is displayed after a proctor call from the com- 
puter familiarization and general instruction module. An example of a proc- 
tor menu screen follows: 
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PROCTOR MENU 

Set one of the following options by 
entering its number, then pressing the 
<YES> key. 



1 RETURN TO TESTING PROCEDURES 

2. EXIT GENERAL INSTRUCTIONS 

3. GO ON TO NEXT SESSION 

Enter choice then press < YES> : 



S pecial Options 

There are four options that the user may find helpful for running the pro- 
gram: 

1 Entering the word "ghosf in the social security number prompt screen 
will call a procedure that inserts random numbers to the test questions and 
will run the program until st Dpped by a < CONTROL> < RESET> . 

2 Bv entering the word "demo" when an examinee's social security 
number is requested, the user will prevent all data for the session from being 
written to the disk. At the end of a demonstration session, the program is 
returned to the normal mode. 

3 A third option allows the user to bypass the keyboard familiarization 
sequence and branch directly to the testing procedures. This is done by press- 
ing the <ESCAPE> key instead of <7> on the initial famdiarization screen 
prompt. 

4. In most modules of the program, the user can exit the procedure by 
pressing the < ESCAPE> key. 

If an examinee successfully completes a full session, a compressed image 
of the results and personal data is written to a text file in the volume QTEXT. 
Each file name begins with an T.' foUowed by the examinee social security 
number and ends with the word Text.' 
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Handling System Failures 



In the event of power loss or something else that causes the computer to 
reboot, a minimal data loss wUl occur. After every subtest, the Corvus disk is 
updated; thus, in the event of a system failure, the user simply reboots and 
runs the program as normal. After logging on, the examinee is returned to 
the beginning of the subtest being taken when the system failure occurred. 

System Fatal or Near-Fatal Error Messages 

1. "Block read io error # This message indicates that the computer 
tried to read a nonexistent block trying to get the te^t for a question, it may 
be caused by bad data or a bad block on the disk. 

2. Infotable Select Error lir. "Cannot give examinee question at this abil- 
ity level." This message indicates that all of the questions at a certain ability 
level in the infotable have been used. The program wUl search the next 
highest level in the infotable to select an item. 

3 "No Strategy Question Select Error." This message means that all avail- 
able questions in the item pool have been given. More questions for a subtest 
have been assigned than there are in the item pool. 

4. "Question load error 11! No such question in directory". "Tried to load 

question # "Directory_slot_... — — — 

message occurs when the infotable data are not valid. The infotable contains 
a reference to a certain directory location that does not contain a question, a 
result of modifying the infotable without verifying it or deleting items from 
the item pool without checking the infotablcs. 



ERIC 



60 

B-7 



SECTIONS 

CONnCtltE TEST PARAMETERS PROGRAM 
(MENU OPTION 3) 



The Confiffure Test Parameters program sets up the parameters that con- 
trol the method of test ad-ninutration. Options appear m the program menu 
as follows: - 



CONFIGURE TEST PARAMETERS MENU [IDS] 
Select one of the foUowing procedures by entering its number. 

1 QUIT 

2. LOOK AT CURRENT PARAMETERS 

3. MODIFY SYSTEM PARAMETERS 

4. CONFIGURE FEEDBACK PARAMETERS 

Enter choice # : 



1. QUIT ^ 
This option tcrmiaates the program and then branches back to ine ^AT 

project menu. ^ 

? LOOK AT CURRENT PARAME TERS 

Selecting this option will display the current configuration of the i ^ame- 
ters thai control the Test Administration program. The screen appears a« fol- 
lows: 



TEST 



LENGTH STRATEGY CKERROR STOFFLAG 



Word Knowledge 15 B 108642 
Numerical Operations 10 Timed 
General Science 15 B 108642 



0.0 
0.0 



No 
No 
No 



Item : none Subtest : screen Session : printer 
Press < RE rURN> to continue 



A few sample tests are included on the screen for Ulustration. The 
-TEsl-^lmn contain, the names of the subtests. The -LENGTH' coluoan 
shows the number of questions that will be given for each subtest. The 
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-STRATEGY- column tells what strategy (Bayesian or timed) is configured for 
each subtest The -CKERROR" column contains the lower limit allowed for 
"fvLtL'e of an examinee's estimated abUity. 'STOPFLAG; -fe- to the 
flag that will stop a session immediately following the completion of the sub- 
test Listed across the bottom of the display are the three par^eters relating 
to feedback. These will be described in items M through 4.4 of this section. 

S MODIFY SYSTEM PARAMETERS 

Selecting this option from the Configure Test Parameters Menu allows the 
user to set up or change the system parameters simply entering the number of 
the item on the following screen: _ 



MODIFY PARAMETERS MENU 
Select one of the following procedures by entering its number. 
1. QUIT 

2 MODIFY LIST OF SUBTESTS TO GIVE 

3 ORDER THE SUBTESTS 

4. CONFIGURE SUBTEST LENGTH 

5. CONFIGURE STRATEGY 

6 CONFIGURE VARLVNCE CUT-OFF 
7. CONFIGURE SUBTEST STOP FLAG 

Enter choice # : 



3.1. QUIT 

This option in the Modify Parameters menu will cause the program 
branch back to the Configure Test Parameters menu. 



3 2 MODIFY f-TST OF SUBT ESTS TO GIVE 

Selecting this option displays a list of the tests that are currently 
configured for administration and allows additions or deletions, as m the fol- 
lowing example: 
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Tests currently in list 



Instructions 



Word Knowledge 
General Science 
Arithmetic Reasoning 
Numerical Operations 



To add a subtest to the list, 
press the letter 'A.' You 
may have up to 20 subtests. 

To remove a subtest from the 
list, press <retum> until the 
cursor is next to the subtest 
you wish to remove, then press 
the letter 'R.' 



Press 'Q' to quit. 



ORDER T HE SUBTESTS 

This option allows the user to set the order in which th. «»b;«f j;^^ 
administered. Only the subtests previously selected will be available for ord- 
erSa -^c subtests are listed in their current order. To reorder them, type: 
the letteTthat corresponds to the test to be given first. This wilHransfer the 
Lt name from the ^Current Order* column to the "New Order- column- 
ReoeaMhis procedure until all subtests are in the -New Order* column, i the 
Lxt de^red^u^t^^^ frota the "Current Order* column is <*'5^"y 
"he cursor in the "New Order" column, then simply pressing <RETURN> 
JJln transLI that subtest directly to the "New Order* column. The followmg 
example illustrates the process of ordering the subtests: 



Type the letter next to the subtest you wish to put in the new 
order, or press <retum> to keep the same subtest in order. 

New Order Current Order 

1 . General Science A. Word Knowledge 

C. Arithmetic Reasoning 

D. Numerical Operations 
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14 CONFIGTTPF SUBTEST LENGT H 

With this option, the number of questions for any particular subtest may 
be set The subtests are listed in one column, and the corresponding question 

l^tah are Usted in a second column. Only the ^-^'^^'^ ^^^'^^n!^,^^^ 
be listed. To adjust the number of questions, press <RETURN> until the 
c^r ol^ alongside the number to be changed. Then type in the new number 
Joie or t^o dLts), and press the <RETURN> key to accept the new v^ue 
^e curler caf be' moved repeatedly through the list. To accept the final 
configuration, press the letter 'CT (See the following example.) 



From top of list, press < retum> to keep old value. To change 
length, type the new value you want, then press < return> . Press 
'Q' to quit. 

Subtest # ofJ3uestions 

Word Knowledge 15 
General Science 15 
Arithmetic Reasoning 15 
Numerical Operations 10 



35. CONFIGURE STRATEGY 

This option allows the user to select the strategy that will be o" a 
particular subtest. The subtests are listed along with their presently 
configured strategies, as in the following example: 



Beginning at the top of the list, type < return> to keep old 
strategy or type the number of the strategy you want. Type 
'Q' to quit. 



Subtest 
Word Knowledge 
General Science 
Arithmetic Reasoning 
Numerical Operations 



Strateg*, 

2. B 54321 

3. B 108642 
1. B 102222 

4. Timed 



Available Strategies 

0. NONE 

1. B 10 2 2 22 

2. B 5 4 3 2 1 

3. B 10 8 6 4 2 

4. TIMED 
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Only the subtests that have been selected from item 32 for administration 
will appear in the Ust. To change a subtest to a different strategy, press 
< RETURN> until the cursor is positioned by the strategy of the test to be 
changed Then type the number corresponding to the desired strategy. The list 
can be traversed repeatedly. When it is acceptable, type the letter "0" to quit. 

There are currently four types of strategies: three Bayesian (Owen, 1975) 
and one timed. With the timed strategy, questions are selected in the oider 
they appear in the data base. The test administration wiU be halted when the 
prescribed time has elapsed. This time is inherent in the subtest name (see 
items 4 and 5, section 4). The Bayesian strategies involve computer controlled 
selection of questions based on the examinee's response to the previous ques- 
tion An infotable contains references to the questions according to their 
difficulty level. If an examinee gets a question wrong, the computer selects 
one of the less difficult ones from the infotable. If he cr she gets it right, a 
more difficult one is selected next. See also item 2, section 6. 

When selecting the Bayesian strategy for a subtest, be certain that an 
infotable exists for that subtest. Otherwise errors will occur. Also, if the 
timed strategy is selected, make sure that the test name mcludes a time limit. 



3.6. CONFIGURE VARIANCE CUT-OFF 

This option allows a user to set the cut-off value for the variance of each 
subtest. Only the subtests selected for administration wiU appear for variance 
cut-off modification. The following example iUustrates this process: 



Beginning at the top of the Ust, type <return> to keep the 
old value or type in the value you want. Type 'Q' to quit. 

Subtest Check error value 

General Science 0.0 
Word Knowledge 0.0 
Arithmetic Reasoning 0.0 
Numerical Operations 0.0 



The Bayesian strategy involves an estimated ability level and also a statistical 
>rariance of that estimate. For any subtest, a lower limit for the variance may 
be set to stop the subtest if the variance falls below it. Administering more 
questions will have no significant effect on the estimated abUity. 
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3.7. CONFIGURE SUBTEST STOP FLAG 

With this option, a flag may be set to stop a series of tests immediately 
following the one(s) flagged. This flag may be set to call a proctor, to prevent 
simultaneous writing to a multiplexed uard disk by two or more examinees, or 
for otker reasons. A list of the available subtests is given along with the 
current configuration of flags. Only the subtests selected in item 32 for 
administration will be listed. U a flag is desired, press <RETURN> until the 
cursor is next to the subtest to be flagged. Then type 'Y' to set the flag. Typ- 
ing 'N' will turn the flag off. An example follows: 



Beginning at the top of the list, type < return> to keep the 

old value or press 'Y' or 'N'. Type 'Q' to quit. 

Subtest Stop 

General Science no 

Word Knowledge no 

Arithmetic Reasoning no 

Numerical Operations no 



4. CONFIGURE FEEDBACK PARAMETERS 

The feedback parameters are optional flags that may be used to indicate 
an examinee's performance. Any or all of the three types can be configured to 
display the performance of an examinee after each question, after each sub- 
test, or after the session has been completed (see the following menu). 



CONFIGURE FEEDBACK MENU 
S ect one of the following options by entering its number. 

1. QUIT 

2. CONFIGURE QUESTION FEEDBACK 

3. CONFIGURE SUBTEST FEEDBACK 

4. CONFIGURE SESSION FEEDBACK 

Enter Choice # : 
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41. QUIT 

This option in the Configure Feedback Parameters menu will make the 
program branch to the Configure Test Parameters menu. 

42. CONFIGURE QUESTION FEEDBACK 

Selecting this option allows the user to set flags so that the correct answer 
will appear on the screen after each question has been answered by the exam- 
inee Another option gives no feedback, in which case each question is fol- 
lowed by the next without any indication of the examinee's performance. A 
record of performance is kept internally, however, in case other types of feed- 
back are selected. A third option provides another question for each 
incorrect response. The current state is indicated at the top of the menu and 
also by displaying that state in reverse video on the display screen. At 
present question feedback exists only for multiple-choice questions. Typmg 
the number of the desired option will set the flag. See the following example 
for a display of these options: 



QUESTION FEEDBACK MENU 
Select one of the following options by entering its number. 
You currently have op. ion : 2 

1. QUIT 

2. NO QUESTION FEEDBACK 

3. RIGHT-WRONG QUESTION FEEDBACK 

4. REMEDIAL QUESTION FEEDBACK 



Enter Choice # : 



43. CONFIGURE SUBTEST FEEDBACK 

This option allows the user to set a flag that sends a summary of the 
examinee's performance to the screen or to a printer after a subtest is com- 
pleted For the Bayesian strategy (Owen, 1975), this summary is a graph show- 
ing the relative percentile that applies to the examinee after each question. 
Other strategies may show a different summary format. The options are 
shown in the illustration that follows. The number of the current option 
appears at the top of the menu and that option is also displayed m reverse 
video Typing a different number will change the flag. Typing T will accept 
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the one displayed. 



SUBTEST FEEDBACK MENU 
Select one of the following options by entering its number. 
You currently have option : 2 

1. QUIT 

2. NO SUBTEST FEEDBACK 

3. SUBTEST FEEDBACK TO SCREEN 

4 SUBTEST FEEDBACK TO PRINTER 

5 SUBTEST FEEDBACK TO SCREEN AND PRINTER 



Enter Choice # : 



4.4. CONFIGURE SESSION FEEDBACK 

Selecting this option allows flags to be set to display or print a summary 
of the examinee's performance for each subtest, but olnly after the final subtest 
has been completed. The following illustration presents the availaole options: 



SESSION FEEDBACK MENU 
Select one of the following options by entering its number. 
You currently have option : 2 

1. QUIT 

2. NO SESSION FEEDBACK) 

3 SESSION FEEDBACK TO SCREEN 

4 SESSION FEEDBACK TO PRINTER 

5. SESSION FEEDBACK TO SCREEN AND PRINTER 

Enter Choice # : 
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SECTION 4 

TEST DATA BASE MANAGEMENT PROGRAM 
(MENU OPTION 4) 



The Test Data Base Management program interacts with the subtests and 
item pool banks. It allows creation, modification, and deletion of .ubtests and 
items. It may be run by selecting the Test Data Base Management opuon from 
the CAT Project menu or by directly executing -CATDATArT^GR." See the 
figure below for available options: 



TEST MANAGER MENU [1.05] 
Select one of the following procedures by entering its number. 

1. QUIT 

2. FETCH A SUBTEST 

3. LIST DIRECTORY 

4. CREATE NEW SUBTEST 

5. CHANGE SUBTEST NAME/FORMAT 

6. TRANSFER SUBTEST TO FI OPPY 

7. DELETE SUBTEST 

8. SEARCH TEXT FOR KEYWORDS 

Enter choice # : 



1. QUIT 

This option in the Test Manager menu terminates the program and then 
branches back to the CAT project xr ?,nn. 

2. FETCH A SUBTEST 

Selecting this option from the Test Manager menu will display the sub- 
tests in a fonnat similar to that she vn in the following figure, which includes 
several sample subtests for illustration: 
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LIST OF SUBTESTS 



1. Arithmetic Rcasoninr 3. Word Knowledge 

2. Numerical Operations " 4. General Science 



INSTRUCTIONS : Enter choice #, then press <RET> 
To escape, press 0, then < RET> . 

Fetch which test? : 



After sele'-ting a subtest, several options are a- aUable, as shown in the 
following illustration: 



FSTCH SUBTEST MBNU 
Select one of the following prr^edures by entering its number. 
Currently managing tubtest : 

1. QUIT 

2. ADD ANEW QUESTION 

3. FETCH AQUESi lON 

4. LIST SUBTEST QUESTIONS 

6. SAMPLE QUESTION MANAGtMEN:; 

6. SUBTEST INSTRUCTIONS MANAGEMENT 

Enter choice # : 



2.1. QUIT 

This option in the Fetch Subtest menu causes the program to branch back 
to the Test Manager menu. 

22. ADD A NEW QUESTION 

The item pool has a capacity of 295 questions per subtest. To get into the 
insert question mode, the user must get lo the Fetch Subtest menu ITiis 
occurs when a new subtest is created, or when the user has selected the Fetch 
a Subtest option from the Test Manager menu. To insert questions for that 
subtest select the Add a New Question option in the Fetch Subtest menu. A 
prompt appears as in the following Ulustration. An integer value is expected 
for the question code number. 
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Enter the question code #, then press < RETURN> 



Then the text editor routine for questions is called. The screen goes 
blank, awaiting entry of text for a question. The available options are as fol- 
lows: 

< left arrow> : Moves cursor one space to the left. 

< right arrow> : Moves cursor one space to the right. 

< CONTROL-P> : Gets another page to continue with the 

text editing. But first an oportunity is 
given to check and modify the current page. 

< CONTROL-C> : Accepts all text, quits, and updates the file. 



The available screen area is determined by certain parameters in the .ab- 
test name (see item 6). The bottom four lines are reserved for system mes- 
sages Features included in the text editor are nonvolatile backspace and 
automatic liiie wrap-around. The question, along with the answer selections, 
should be entered. The screen appears exactly as it will during the Test 
Administration. When the text is satisfactory, press < CONTROL-C> . If the 
question is a graphics item, no text need be typed; <CONTROL-C> is all 
that is needed. After the text has been entered, and <CONTROL-C> is 
pressec', vhe Set Graphics Flag menu is called. 

The Set Graphics Flag menu is used to indicate to the program that the 
question contains graphics. All graphic questions are saved as fotofiXes or 
compressed graphic data files on volume 'CATFOTO.' To load the question 
from a graphics file, the flag must be on. If it is not a graphics item, the flag 
must be off. An error will occur if the flag is on with no corresponding 
fotofile. The following figure illustrates the Graphics Flag menu: 
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SET GRAPHICS FLAG MENU 
Select one of the following options by entering its number. 
You currently have option 2 (no praphic text) 

1. QUIT 

2. GRAPHICS FLAG f ( no graphic text) 

3. NORMAL GRAPHICS FLAG ON 

4. COMPRESSED GRAPHICS FLAG ON 

Enter Choice # : - 



Turn a graphics flag on or off by selecting the number from the Set 
Graphics Flag menu. Then type '1' to quit. 

Next, select the type of answer for this question as shown below: 



SELECT ANSWER TYPE 
Select one of the following options by entering its number. 

1. MULTIPLE CHOICE/SINGLE ANSWER 

2. INTEGER VALUE ANSWER 

3. MULTIPLE CHOICE/MULTIPLE ANSWER 

Enter Choice # : 



The option most often used is multiple choice/single answer, while the 
o»her two options are used for subtests with special formats. Select one of 
these three forms. After either option 1 or 3 are chosen, the followmg will 

apear: 



ENTER ANSWER SELECTION RANGE 
Low bound? (letter/digit) : 
High bound? : 
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A low bound and a high bound are requested. These ^lU be ^pha- 
nutneric characters constituting the range of the answer selections, For exam- 
pie a question with four choices for the answer wUl P-^ably have a range 
-A X>- or -1 4- Enter the range. Next, the answer is requested. The follow- 
ingmustrate sample display screens for each of the th^ee possible responses to 
the Select Answer Type menu: 



ENTER MULTIPLE CHOICE/SINGLE ANSWER 
The answer range is : A.X) 
Enter answer and then press < RET> : 



ENTER INTEGER VALUE ANSWER 
Enter answer (integer value) and then press <RET> : 



ENTER MULTIPLE CHOICE/MULTIPLE ANSWERS 
The answer range is : A.X) 

Enter the number of answers this question has (1..7) : 2 
Enter answer 1, then press <RET> : 
Enter answer 2, then press < RET> : 



Finally, three parameters. A3, and C. .^e entered Real numbers are 
exoected here The 'A' parameter is an ability discrimination factor re ated to 
the^lo^ of the item characteristic curve. The "B' parameter is a dif iculty 
actor^ie X- parameter is a guessing factor. The screen appears as follows: 
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Enter A parameter value, then press < RET> 
Enter B parameter value, then press < RET> 
Enter C parameter value, then press < RET> 



After entering these parameters, the data should be ve:ified by the user. 
The screen appears as illustrated below. If everything is correct, type 1, and 
the question will be accepted into the d^ta base. If an item is incorrect, it can 
be altered by typing the appropriate number. 



VERIFY QUESTION DATA MENU 



Select one of the following options by entering its number. 

Current data : A parameter = 
B parameter = 
C parameter = " 

1. QUIT (data ok) 

2. CHANGE PARAMETER A 

3. CHANGE PARAMETER B 

4. CHANGE PARAMETER C 

Enter Choice # : 



2-^. FETCH A C ;ESTigN 

Selecting this option gives several choices. Entev the question's item code 
as an integer value If no item in fhc data base matches the code number 
entered, the prci^am will di.^.iay an ..ror message and then branch back to 
Ihe Fetch a Subtrst menu. If the item is fouwd, tbc screen appears as follows:. 
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FETCH ITEM MENU 



Select one of the following options by entering its number. 
Currently managing question : 

1. QUIT 

2. DISPLAY QUESTION TEXT 

3. DISPLAY QUESTION DATA 

4. MODIFY QUESTION 

5. DELETE QUESTION 

6. SET GRAPHICS FLAG 

Enter choice # : 



23,1. QUIT 

This option in the Fetch Item menu causes the program iv> r?tcnch back to 
Fetch Subtest uienu. 

ov^ni^ AY QT JESTION TEXT 

Select this option from the Fetch Itsm menu to view the text for a ques- 
tion The text will appear on the screen exactly as it wo-M durmg the actual 
test, except that the item code and the correct answer are ahn hown. 

2 J3. DISPLAY Q Ug_STIQN_DAIA 

When this option is chosen ? rom the Fetch Item menu, a s vimary of the 
data for the question it displayed as follows: 
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QUESTION DATA 



A Parameter : 
B Parameter : 
C Parameter : 
Answer type : 
Answer : 
Graphics Flag : 
Block which text begins : 
Byte in block : 

Press < RET> to continue 



23.4. MODIFY QUESTION 

This selection from the Fetch Item menu brings up the following menu. 
Either the text or data parameters for any question in the data base may be 
modified using this option. 



MODIFY QUESTION MENU 
Sr -ct ore of the following by entering its number. 
Currently managing SESSION files. 

1. QUIT 

2. CHANGE QUESTION CODE 

3. CHANGE QUESTION TEXT 

4. CHANGE ANSWER RANGE 

5. CHANGE ANSWER 

6. CHANGE QUESTION DATA 

Enter choice # : 



23.41. QUIT 

This option in the Modify Question, menu wiU cause the program to 
branch back to the Fetch Item menu. 
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o-KA.-) THANGE QUESTION CODE 

This option in the Modify Question menu aUows a change in the item 
code number for the question under consideration. It can cause problems in 
other parts of the program unless care is taken. Notice the warning message 
shown in the following figure. The Strategy Data Bare Management program 
must be run after modifying a question. 



The current question ID code is : 

Enter the new identification code and then press < retum> : 

The new ID # is : 

••••••• IMPORTANT ••••••• 

Since you have changed the question ID code, this may affect 
the strategy data base structures. The strategy database may 
contain the item just changed and, if so, errors may occur 
during test administration when the strategy selects a ques- 
tion no longer identified by its old ID #. Thus, to make sure 
the strategy data is still OK, you should run the 'Verify 
option for each strategy data structure this subtest has. 

Press < return> to continue 



23.43. CHANGE QUESTION TEXT 

Selecting this option from the Modify Question menu displays the old text 
for the question and puts the user in the editor mode for test questi^Dn^^^ New 
text can be added or old text deleted and changed. Typing < CONTROL-O 
will accept the text on the screen as the new text for the question. 

23.4.4. CHANGE ANSWER RANGE 

This option in the Modify Question menu gives the user an opportunity to 
expand or diminish the range of possible answers for an item. When the 
current range is displayed, the new values are requested These may be any 
letter or digit. For example, an old range of 'A.X)' may be changed to I. .5, 
as ht the following example: 
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Current range : A.J) 

New low bound? Octter/digit) : 1 
New high bound? (letter/digit) : 5 

The new ran^e is : l.i 
Press < RET> to continue 



After <RETURN> is pressed, the program branches back to the Modify 
Question menu. 

2 3.4.5. CHANGE ANSWER 

This option in the Modify Question Menu is similar to Add a New Ques- 
tion in the Fetch Subtest menu. The current answer is displayed first. Then 
the new data are typed as if this were a new question, beginning with the 
answer type. The menus are the same as the Fetch Subtest menus. 

23.4.6. CHANGE QUESTI ON DATA 

This option in the Modify Question menu displays the same menu as the 
Verify Question Data menu presented previously. It facilitates changmg the 
A3, & C parameters. 

23.5. DELETE QUESTION 

Deleting a question removes it from the subtest directory. The empty 
space is indicated by '-1'. To prevent accidental deletions, a wammg is ^ven 
l^forehand as in the following Ulustration. VERIFY the strategy data base 
after deleting. 
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WARNING 



You have selected the delete question option. This, will 
remove the question from the subtest item pool. Are you 
sure you want to delete ? 



Press 'N' or "Y' : Y 



Deleting ... 



23.6. SET GRAPHICS FLAG 

Setting the graphics flag informs the Test Administration program that 
the text for this particular question is graphic and is in a fotofile or 
compressed graphic data file If the flag is set when no graphics file e«8t8 for 
the question, an lO error will occur. To change the flag, select Fetch a Sub- 
test Fetch a Question, and Set a Graphics Flag. The menu that appears will 
the current state of the flag. Set or reset it by typing the appropriate 
number. The following figure presents the Set Graphics Flag menu: 



SET GRAPHICS FLAG MENU 

Select one of the following options by entering its number. 
You currently have option 2 (no graphic text) 

1. QUIT 

2. GRAPHICS FLAG OFF (no graphic text) 
3 NORMAL GRAPHICS FLAG ON 

4. COMPRESSED GRAPHICS FLAG ON 

Enter Choice # : 



2.4. LIST SUBTEST QUESTIONS 

To list the entire subtest (instructions, r amples. and the item pool), select 
List Subtest Questions from the Fetch Subtest menu. The followmg screen 
will appear: 
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Select one of the following options by entering its number. 

1. QUIT 

2. COMPLETE LISTING 

3. PARTIAL LISTING 

Enter Choice # : 



It is possible to select the Complete Listing option and Ust the text to the 
screen, terminating the listing after any single question has been -displayed by 
pressing the < ESCAPE> key. U a printed copy of the items in a particular 
subtest is needed, the Output Selection menu aUows that option. The "data" 
referred to in the menu contain all of the parameters for each item. The 
name of the file wUl be needed for options 6 and 7 (see the foUowing Ulustra- 
tion). 



OUTPUT SELECTION MENU 
Select one of the following options by entering its number. 

1. QUIT 

2. TEXT TO CONSOLE 

3. DATA TO CONSOLE 

4. TEXT TO PRINTER 

5. DATA TO PRINTER 

6. TEXT TO FILE 

7. DATA TO FILE 

Enter choice # : 



L 



If a partial listing is desired, the range of item codes is requested as 
-hewn in the following screen. Only the items within that range will be listed. 
Fhe same options are available for a partial list as for the complete Ust. 
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ENTER RANGE OF ITEM CODES TO LIST 
List all items between item code : 
and item code : 



2.5. SAMPLE QUESTION M ANAGEMENT 

Selecting this option from the Fetch Subtest menu gives access to the 
sample items for the current subtest. Each subtest has space for a maximum 
of five sample questions. The Test Administration program will display as 
many samples as exist for the subtest, through the foUowmg menu: 



SUBTEST SAMPLES MENU 
Select one of the following procedures by entering its number: 



L QUIT 

2. ENTER SAMPLE QUESTION 

3. VIEW SAMPLE QUESTION 

4. MODIFY SAMPLE QUESTION 

5. DELETE SAMPLE QUESTION 

Enter Choice # : 



2.5.1. QUIT 

This option in the Subtest Samples menu causes the program to branch 
back to the Fetch Subtest menu. 



2.52. ENTER SAMPLE QUESTION 

This option allows a user to enter a new sample question for the subtest. 
The screen first displays the number of sample questions already created. For 
example, if two samples exist, the display will appear as follows: 
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Sample question 1 exists. 
Sample question 2 exists. 

Make which sample question (1.5) 
Eater the number then press < RET> : 



The new question should be given the next number in sequence, in this case 
number 3. After the number is entered, the screen goes blank, awaiting the 
text for the sample question. iTie sequence of entries and display screens is 
identical to that for the Add a New Question option of the Fetch Subtest 
menu. The A, B, and C parameters aie not entered for sample questions. 

2.53. VIEW SAMPLE QUESTION 

This option will allow a user to select any of tbz sample questions that 
exist for thic subtest and display it on the screen. Th© display app ars as fol- 
lows: 



View which sample tiuestion (1.3) 
Enter the number then press < RET> : 



2.5.4. MODIFY SAMPLE QUESTION 

This option allows a user to modify the tert, answer range, answer, or 
graphics flag of a sample question. Each modification selection displays the 
part of the rogram that made the original sample question. That is, thr 
selection of odify Sample Text allows the editing of the text for the sample 
question. Modify Answer displays the old answer and requests the new 
answer. Modify Answer Range displays the old range and requests the new 
low bound and high bound, and Modify Graphics Flag shows the current 
option and allows the flag to be set or reset. The menu appears as follows: 
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MODIFY SAMPLE QUESTIONS MENU 



Select one of the following procedures by entering its nu 
1. QUIT 

2 MODIFY SAMPLE TEXT 

3 MODIFY SAMPLE ANSWER 

4. MODIFY SAMPLE ANSWER RANGE 

5. MODIFY GRAPHICS FLAG 

Enter Choice # : 



2 5.5 DELETE SAMPLE QUESTION 

Selecting this option allows any sample question currently in a subtest to 
be deleted. After a sample question is deleted, the number of that question 
may be used again by entering a new sample question. The screen presents 
the following warning: 



WARNING 



You have selected the 'delete sample question' option. This 
will purge an existing sample question from the files. 

Do you wish to continue? Press 'N' or 'Y' : 



?■ 6 SUBTEST INSTRUCTIONS MaNAGE?>1ENT 

Selecting this option from the Fetch Subtest menu allows a user to enter, 
modify delete, or view the instructions displayed on the screen before a sub- 
test These instructions consist of general text information that the examinee 
needs before beginning the subxest. If no instructions exist for a subtest the 
program for Test Administration skips over this part. That is. does not try 
io Jvc instructions if none can be found, and no error occurs. The menu is 
displayed as follows: 



8j 

O B-30 

ERIC 



SUBTEST INSTRUCTIONS MENU 
Select one of the following procedures by entering its number: 

1. QUIT 

2. ENTER INSTRUCTIONS 

3. VIEW INSTRUCTIONS 

4. MODIFY INSTRUCTIONS 

5. DELETE INSTRUCTIONS 

Enter Choice # : 



2.6.1. QUIT 

This option in the Subtest Instructions menu causes the program to 
branch back to the Fetch Subtest menu. 

2.6.2. ENTER INSTRUCTIONS 

This option allows the user to enter text for subtest instructions. If 
instructions already exist, an error message is displayed. To add to those 
astructions, either delete them and ente- the new ones, or select the modify 
ortion, which displays an empty screen and asks for the text. It is accepted by 
pressing < CONTROL-O . 



2.63. VIEW INSTRUCTIONS 

This option will display the subtest instructions on the screen. The tc 
appears just as it would during the test administration. 

2.6.4. MODIFY INSTRUCTIONS 

This option allows a user to change the subtest instructions. This opti 
displcys the old text and puts the user in the test text editor to add, delete, 
change the old text. A chance to escape this option is given as follows: 



Change instruction text? Press 'N' or Hi" : 
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2 6.5. DELETF INSTRUCTIONS 

This option removes all instructions for a subtest. Because it destroys the 
only copy of these instructions, a warning is displayed first, as follows: 



sVAJlNING 



You have selected the 'delete instructions' option. This 
will purge the existing instructions from the files. 

Do you wish io delete the instructions? Press 'N' or 'Y' : 



This option concludes the documentation for the Fetch Subtest option in 
the Test Manager menu (page I.l). The next few pages will present the remain- 
ing choices in the Test Manager menu. 

^ LIST DIRECTORY ^ ^ 

This option in the Test Manager menu displays the directory oi suutests 
along w th the number of questions contained in each. The list of subtests is 
delayed and pressing <iCeTURN> will cause the program to branch back 
to the Test Manager menu. See the following example for format: 



LIST OF SUBTESTS 



1. Arithmetic Reasoning (201) 3 Word Knowledge (194) 

2. Numerical Operations (50) 4. General Science (197) 



4 files in directory, 17 unused. 
Press < RET> to continue 



4 rPFA TF. NEW SUBTEST 

Electing this option in the Test Manager menu ^"^^^^."rclVsvstem' 
new subte-t, to the maximum of 21 subtests that can exist m the CAT system. 
^Ts u t of the program puts only the name of the new subtest into the direc- 
Zy ' ^cn the program branches to Fetch a Subtest for entering questions 
!"d parameters. Thf following figure illustrates the screen that appears for 
this option: 
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SUBTEST NAME FORMAT INSTRUCTIONS 

The first character of the subtest name specifics which screen 
format the question text will appear in. The screen codes are 
listed below. The second character of the subtest name spec- 
ifies the total permitted time in minutes for timed subtests. 
The second and third characters specify the addition seconds 
permitted for the timed tests. Type in the subtest name and 
press <RETURN> . 

as first char = inverse + 80 columns 
'@' as first char = normal + 80 columns 
'?' as first char = normal + 40 columns 

If first character of test name is not any o' the above con- 
trol characters, then the text format will default to : 
inverse + 40 columns. 

Change to what ? 



After the subtest name has been entered, the n-xt menu lo appear is 
Fetch Subtest menu. 



5. CHANGE SUBTEST NAME/FORMAT 

The name of a -ubtest can easily oe changed by selecting this option, 
which is organized like the Create a New Subtest option (item 4, above). The 
first thing that appears or the screen in a list of all of the subtests currently m 
the directory. A prompt appears asking for the subtest name to be changed. 
After the user enters the number of the desired subtest, the format of the new 
name is described. Enter the name as if it were a new subtest. The format of 
a subtest can be changed in a similar manner. Again, it is treated as if a new 
subtest were being created; the entire name, including the format characters, 
is typed in place of the old name (see section 4). If the lext for a question m a 
subtest is typed on an 80-column screen, it cannot be displayed o.i a 40- 
column screen. Likewise, if it was typed on a 40-colunin screen originally, it 
will appear off to the side on an 80-column screen. Thus, if the format is 
changed after the text has been entered, it may not appear as intended. This 
option also allows a time limit to be set fcr timed subtests. The test adminis- 
tration program keeps track of the time an examinee spends on each subtest. 
For a timed subtest, the test is halted when the allotted time has expired. 
This allotted time pecified by three digits in tht subtest name, as m item L 
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6. TRANSFER SUBTEST TO FLOPPY 

Existing data files are too large for a floppy disk. This option wlJ isolate 
an individual test and write its data on a floppy disk in a format similar to the 
large data file. The program F.TMGR aUows access to the floppy file It con- 
tains procedures similar to TA4GR, but designed to access a floppy. A Ust of 
the available subtests is displayed, requesting the name of the test to transfer. 
Then a promp* appears on the screen as follows: 



Enter destination file name, then press < RETURN> 



> 



The destination file name should be liC more than four characters in length. 
It can be prefixed with a volume name. Three data files are created usiiig ih-. 
filename, as follows: 

1. /volume/file name X)IRX>ATA, 2. /volume/file name DATADATA, 3. 
/volume/file name .TEXTX)ATA. 

The first file is the subtest directory, the second contams the data aiid parame- 
ters for the questions in the subtest, and the third file co^.ta^ns the text fc the 
questions. 



7. DELETE SUBIEST 

This option a''3ws the user to remove a>t i.. wan ted 'lubtest permanently, 
by removing the subtest name from the ectory and then removing any 
reference pointers to the questions. Because the deletion is per.raj-nt, the 
following warning is displayed first: 



WARNING 



You have selected the 'Delete Subtest' option. This will 
purge the subtesl directory from the database and the 
item banks for the subtest will cease to exist. 

Do you wish to continue? Press 'N' or 'Y' : , 



Pressing 'N' branches back to the Test Manager menu (page I-l). Pressing 'Y' 
dis-lays the directory of subtests. The prompt requests the n-imber of the 
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subtests to be deleted. Upon selection of a subtest, one more rhance is given 
to escape, as follows: 



Purge (TEST NAME)? Press 'Y' or 'N' : 



Pressing 'N' again branches to the Test Manager menu. Pressins 'Y begins \be 
deletion process. A dot is written on the screen for each question in the data 
base as its reference pointer is deleted. Then the program bitches to the 
Test Manager menu. 

8 . SEARCH TEXT FOR KEYWORDS 

This oi:<*ion allows the user io search the item text data base for up to ten 
key words. The user must first choose the subtest to be searched from th " 
List of Subtestts nienu. The user must then enter the number of key wc -ds to 
be searched in the data base of the chosen subtest. The program wiU prompt 
the uscf for the key word(s) and then return with the Output Sclecuon me)^u. 
The Output Selection menu provides the user with the options of sending e 
text containing these key words to the console, to a printer, or to a text file, 
A quit option exists to return to the Test Manager menu. Once an output 
option has been selected, the program will perform the search process, output 
the results, and then branch back to the Test Manager menu. 
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SECTION 5 

EXAf/^TNEE DATA BASE MANAGEMENT PROGRAM 
(MENU OPTION 5) 



The Examinee Data Base Manageemcnt program maintains and provides 
access to a data ba^e of up to 50 examinees. An examinee must be logged mto 
^'. da ° base to be administered a series of subtests. Loggmg in reserves space 
n memory for ^he results of the examinee's testing. The initial menu is as fol- 



iows: 



EXAMINEE MANAGER MENU [lXi5] 
Select one of the following procedures by entering its aumber. 
Currently managing SESSION files. 

1. QUIT 

2. LOG EXAMINEE INTO SYSTEM 

3 ENTER EXAMINEE PERSONAL DATA 

4. VIEW EXAMINEE RECORDS 

5. LIST DIRECTORY 

6. SEPARATE DONE/NOT DONE EXAMINEES 

7. SELECT FILES TO MANAGE 

8. REMOVE EXAMINEE 

9. PURGE DIRECTORY 

Enter choice # : 



1. QUIT 

This option in the Examinee Data Base Menu terminates the Examinee 
Manager program and then branches back to the CAT Project menu. 
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2 LOG EXAMU^EE INTO SYSTEM 

When an examinee's social security number is entered, it is either 
accepted or rejected, depending on whether the limit of 50 exammees has 
been reached, 'whether the examinee has previously logged .n. and whether 
the examinee has already finished with testing- The screen displays the fol- 
lowing: 



B-36 



Enter Examinee Social Security number : 



< RETURN > 



The computer checks to see whether that number exists already. " so a" 
^or mlZl is displayed. Otherwise, the number is entered into the data 
base and the screen appears as follows: 



Examinee (. ) entered into system. 

Press < RET> to continue logging in examinees or 
press < ESC> to quit. 



^ ENTER EXAMINEE P FftSONAL DATA 

With this option a proctor may enter or modify an examinee's personal 
dataTe^rd T^e e"cord'consists of'various fields, each of which .s restricted 
tn l ce^Iin tvpe of input. Some fields may contain only digits, some only 
LVaS chrtefs. an'd some both. THe date field require, a T to separate 
da^-. month, and year. If inappropriate data are entered. ^ /^Z^^" Jj^^ 
«,i;d Firs . the examinee's social security number is requested. If the social 
Scurity number has not been logged in previously, an error message -s 
printed. Otherwise the screen appears as follows: 
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DATA ENTRY INSTRUCTIONS : To enter/modify data, type in the 
data you want and then press < RET> to accept that data. To 
skip the current field, just press < RET> . To quit, press 
< ESC> . 

Last Name : First Name : Middle Initial : 

Current Address (state) : Home of Record (state) : 
Citizenship : 
Sex : 

Population Group : _ 

Ethnic Group : 

Marital Status : 

Number of Dependents : 

Date of Birth : 

Education : 

Test ID : 

AFQT : 

ASVAB Scores : 
Date of Enlistment : 
Active Service Date : 
Rating / MOS : 
AFEES : 

Branch of Service : 
Retest ASVAB : 
Test order : 



After the data have been entered, certain items are requested a second time 
in a check to confirm that the data are correct. For this check, the screen 
appears as follows: 



Last name : 
ASVAB Scores : 
Rating / MOS : 
Reiest ASVAB scores 



The computer compares the two entries for each of these important 
items; if they do not match, an error message is displayed. Otherwise the 
screen shows the following comparisons: 
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Previous Last Name : 
Verified Last Name : 

Previous ASVAB Scores : 
Verified ASVAB Scores : 



Previous Rating / MOS : 
Verified Rating / MOS : 

Previous Retest ASVAB Scores : 
Verified Retest ASVAB Scores : 

Verified data is ok. 

Press < RET> to continue. 



4. VIEW EXANflNEE RECORDS 

This option allows a proctor to transfer an examinee record to the con- 
sole a printer, or a file. The record displayed contains the examinee's per- 
sonal data and all subtest results. The procedure requests first the examinee s 
social security number and then a destination for the output. The console and 
printer options display a long tabular summary. The file option writes a 
compressed version into a text file for the SPSS data analysis. The record 
displayed has the same format as the one displayed for option 3, without the 
instructions at the top. 

5. LIST DIRECTORY 

This option displays the list of examinees logged into the system and the 
corresponding current status in the testing sequence. The status of the exam- 
inee is one of the following: new examinee-no subtest started; done 
examinee -session fully completed; or examinee with some subtests 
completed-the number of finished tests is mdicated. 



6. SEPARATE DONE/ NOT DONE EXAMINEES 

When this option is selected, data for examinees who have finished all of 
the assigned subtests are transferred to another file whose format is identical 
to the first Thus, two similar file systems exist, one with examinees who axe 
finished, and one with those who are not. This arrangement allows the 
E.MGR program to access either file with the same routines. 
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Access to examinee files is separated into two categories: ^^1" of exam- 
inees currently in session, and files of examinees who ^ave completed the test^ 
The user must specify which group of files to be managed through the Select 
Files to Manage option. When this option is chosen, a -n^^"" ^PP"; 
the following diagram. The user must enter a choice nuniber and then press 
he -r kly optiofto quit the screen. The program will then branch back to 
the Examinee Manager menu with the selected file structure indicated m the 
heading Th^ opnoL described previously in this section for file management 



may then be used. 



SPECIFY FILES MENU 

Select one of the options by entering its # 
You currently have option: 2 



1. QUIT 

2 MANAGE SESSION FILES 

3. MANAGE DONE EXAMINEES 

Enter choice #: 



«■ REMOVE EXAMINEE 

This option deletes a specified examinee from the files It is used to 
remove examinees for whom data are no longer required. Deletion is accom- 
plished by enterir-g the examinee's ID number in the specified space on the 



screen. 



Q PURGE DIRECTORY 

When the data for all examinees are no longer needed, this option 
removes all the examinee records and the directory, thus allowing 50 new 
examinees to be logged in. 
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SECTION 6 

STRATEGY DATA BASE MANAGEMENT PilOGRAM 
(MENU OPTION 6) 



The Strategy Data Base Management program handles the data structures 
used in selecting questions to be given an examinee during test administration. 
Currently, two strategies are used. A timed test selects questions in the same 
order as they appear in the data base, and all examinees arc given identical 
tests. That strategy does not involve the use of this program at all. The other 
strategy (option 2, below) uses Bayesian formulas and techniques (Owen, 
1975), and involves an information table of questions for each subtest. Two 
more strategies are listed in the menu but have not yet been implemented. 



STRATEGY DATABASE MENU [1.05) 
Select one of the following procedures by entering its number. 

1. QUIT 

2. INFOT ABLE MANAGEMENT 

3. PYRAMIDAL MANAGEMENT (not available) 

4. FLEXILEVEL MANAGE. HNT (not available) 

Enter choice # : 



Note, Pyramidal Management and Flexilevei Management, options 3 and 4, are 
not beiiig implemented in the current version of the CAT systr aa. 

1. QUIT 

This option in the Strategy Data Base meru terminates the Strategy 
Manager program and then branches back to the CAT Project menu. 

?■ INFOTABL E MANAGEMENT 

SelectLng this option in the Strategy Data Base menu gives access to the 
information table data structure in order to create, mcdifv, verify, or view the 
infotable. Basically, t'ie infotable is a matrix of 36 rows by 20 columns; each 
entry is a number that refers to a question in the data base. There are actu- 
ally two such tables for each subtest. The one visible to the user contains item 
code numbers of the questions referred to, A second table contains the actual 
location in the data base of the corresponding question. It iy this second table 
that is used by the program to access the file of questions and reprieve a ques- 
tion to be administered. 
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The rows of the infotable correspond to abUity levels. The items m each 
row of the information table are sorted in order of information, with the first 
item having the greatest information for that level of ability. Row 0 contains 
the sequence of item numbers whose information values were calculated at a 
theta value of -225. The information values in row 1 were calculated for a 
theta value of -2.125, and so on. When a subtest is administered, the first ques- 
tion is selected from row 19 (theta value of 0). The first five items in that row 
(columns 1 to 5) are taken as a group from which a question is chosen at ran- 
dom This random selection prevents two adjacent examinees from getting the 
same test. After an examinee answers a question, a new ability level is calcu- 
lated based on whether the answer was correct or incorrect, and the next 
question is selected at random from the row corresponding to the new ability 
level The process is repeated until the end of the subtest. Since the same 
item code number can appear in more than one row, items that have already 
been used are ignored when selecting a grour of five questions from which to 
make a random selection. When this option is chosen, the screen appears as 



follows: 



INFOTABLE MANAGER MF.NU 
Select one of the following procedures by entering its number. 

1. QUIT 

2. MAKE NEW INFOTABLE 

3. LIST INFOTABLE 

4. VERIFY INFOTABLE 

5. MODIFY INFOTABLE 

6. FIND ITEMS IN INFOTABLE 

7. ANALYZE INFOTABLE ROWS 

Enter choice # : 



2.1. QUIT 

This option in the Infotable Manager menu will cause the program to 
branch to the Strategy Data Base menu. 

2^VtAKF NEW INFO TABLE 

This option allows the creation o an information table where none 
existed before, or where an old one is to be replaced by a new one. First, a 
list of subtests similar to the following one is displayed: 
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LIST OF SUBTESTS 

1. Arithmetic Reasonmg 3. Word knowledge 

2. Numerical Operations 4. General Science 

INSTRUCTIONS : Enter choice #, then press < RET> 
To escape, press 0, then < RET> 

Make new infotable for which test? 



A test is selected by entering its r,orresponding number. The options 
available for makf: ,, an j.nfotable are listed in the following menu: 



MAKE INFOTABLE FOR : 

Select oae of the following options by entering its number. 



1. QUIT 

2 INFOTABLE FOR A SINGLE ABILITY LEVEL THETA 

^ READ INFOTABLE VALUES FROM A TEXTFILE 

4. COMPUTE INFOTABLE VALUES FROM INTERNAL PARAMS 

Enter choice # : 



22.1. QUIT 

Selecting this . i from the Make Infotable menu will cause the pro- 
eram to branch back to be InfotaWe Manager menu. 



INFOTAB LE FOR A SINGLE A HIIJTY LEVEL THETA 
This option calculates the actual information value for each question in 
the data base. The A, B, and C parameters in the data b?&e are used along 
with any desired value for theta, which is input from the ^icyboard to perform 
the calculations: 
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ENTER ABILITY LEVEL (real number between -25 and +2^ 
(If a number is between 0 and 1, it must be entered as 0.) 

THETA : 



The i >rmula for the calculation of infovalues is complex, but it can be 
examined tv looking at the text file listing for the Strategy Data Base Manage- 
ment progru ' It is in INFO, a function located in text file SMGRDIR/ 
SJ^EWTEXl For each of 36 ability levels, this function returns a value for 
a single item in the data base. The function is called once for each item 
included in a subtest. The values returned by the function are placed into an 
array along with their corresponding item code numbers. The values are then 
sorted, with the largest first since the largest information value implies that 
this particular question is the best one to use for this ability level. Once the 
values are sorted, the entire array is printed on the screen or a printer as 
shown in the following: 



Where do you want to send the output? 

1) Screen 

2) Printer 



SORTED INFOTABLE FOR General Science T = 1300 



ITEM 


INFOVALUE 


ITEM 


INFOVALUE 


ITEM 


1317 


3.7846830 


1422 


33725095 


28 


717 


2.6544909 


1012 


22363446 


929 


1429 


1.8138728 


27 


12964287 


1501 


210 


1.0873929 


626 


1D362686 


1103 


1001 


1.0002778 


1024 


05402365 


204 


11 


0.9227784 


802 


0SO31849 


822 


114 


0.8394207 


9 


0A175129 


620 


201 


0.7606946 


813 


0.7527739 


1212 


707 


0.6530995 


709 


Oj6500925 


1223 



INFOVALUE 

3.4566457 
2.1980641 
12836412 
1.0162244 
0.9360374 
0.8506458 
0.8102215 
0.7054430 
0.6418954 
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223. READ INFOTABLE VALUES FROM A TEXTFILE 

Selecting this option allows the user to create the infotables on a 
different computer and transfer them to this data base via a floppy disk oi 
other medium. The program reads a text file and enters the data into the 
array for the infotable. Tbe file must contain information in the following 
format: 

a. There must be ex.c y 720 integers (each one corresponding to an item 
code number). 

b. Since the infotable consists of 36 rows of 20 items, the file can be read 
directly into the infotable array, and is read one row at a time. Thus, each 
item in the file must be in exactly the same position it will be in the infotable. 

c. Integers must be separated by at least one blank or a linefeed/carriage 
return. 

d. No characters are allowed; only integers. The screen prompts the user 
to enter the name of the file as follows: 



Enter input filename, ther. pres&-<ilET> : 



After reading the file, a check is made internally to assure that the correct 
number of items were entered; if they were not, an error message is displayed. 

22.4. COMPUTE INFOTABLE VALUES FROM IN TERNAL PARAMS 

Selecting this option allows the user simply to sit back and watch the 
computer do all the work. As soon as the option is selected, the A, B, and C 
parameters for this subtest are loaded from the data base. The screen displays 
an information line to let the user know that something is happening (it takes 
a few seconds to load). 



Loading parameters from file 



Then the computer calculates an information value for each of the questions 
similarly to option 222, above. The value of theta initially is -225. After the 
information values have been computed for this theta, tbe items are sorted 
and the best 20 are placed into the infotable's first row. The screen appears as 
follows, writing dots occasionally to indicate that the computer is working: 
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Computing infovalues for THETA 
Sorting the infotable 



= -22500 



Theta is then incremented by 0.125 and the process is repeated, continuing 
until all 36 rows have been computed, sorted, and stored. Depending on the 
number of questions in the subtest's data base, the process of creatmg the new 
infotable can take up to 30 minutes. The program will branch to the venfy* 
option (see section 2.4) after the new infotable has been completed. 



23. LIST ZNFOTABLE 

This option will list the infotable on the screen, a printer, or to a file, as 
follows: 



SELECT OUTPUT MENU 
Select one of the following options by entering its number. 

1. QUIT 

2. LIST INFOTABLE TO SCREEN 

3. LIST INFOTABLE TO PRINTER 

4. LIST INFOTABLE TO FLOPPY DATA FILE 

5. LIST INFOTABLE TO TEXT FILE 



-^ae printed infotable has item code numbers as values in the table. A partial 
sample (with 8 columns instead of 20) is shown in the following table. An 
o'^tion exists that is hidden from the average user due to its limited value. 
The actual infotable that is used by the program consists of offset values that 
index the locations of the data questions for that subtest. These values will 
always be less than 300. To get a listing of this infotable from the Infotable 
Manager menu, type 'L' instead of '3.' 
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INFORMATION TABLE 
Test: Arithmetic Reasoning 





1 

1 


z 


'I 

-7 


4. 


5 


6 




8 


11 


lUo 


Zu 




1116 


17 

X 1 


406 


1013 


1518 


21 


1 no 
lUo 


11Z4 


7/1 
ZU 


1116 


17 

X 1 


1115 


ilS 


406 


31 


1 no 
lUo 


11Z4 


70 
xu 


1116 


17 

X 9 


1115 


"'18 


109 


A I 

41 


11Z4 


IVIO 


70 


17 


1116 


1115 


19 


1518 


51 


11Z4 


lUO 


70 


17 


1116 

X XX\J 


1115 




516 


Dl 




infl 


17 


20 


109 


1115 


516 


207 


71 


11^ 


Iflfl 


7j07 


S16 


109 


17 


13 


1115 


Ol 

81 


11Z4 


ZU/ 


10ft 


13 


516 


109 


806 


17 


91 


2XM 


1 10A 


l'^ 


1412 


806 


516 


108 


109 


lUI 


ZU/ 


lAO 
l*f IZ 




72S 


1124 


626 


806 


516 


111 


141Z 




77^ 




12 


13 


806 


227 


121 


141Z 






12 


1424 


207 


227 


1514 


131 


1412 


14Z4 


77^ 


11 


428 


626 


1527 


227 


141 


1412 


1 >lOA 
14Z4 


A7fl 


12 


725 


1527 


722 


227 


15! 


1412 


1 A^A 

14Z4 


A7fl 


1^7 

xD^ 1 


12 

X** 


1122 

X XS0m0 


618 


1110 


161 


y A^ A 
14Z4 


A1 Q 
Dlo 


A7fl 


1412 


1110 

X X X\9 


1122 


1527 


613 


171 


618 


lllU 


A7Q 


1 A7A 


1177 
1 XA0A0 


1205 


613 


1410 


181 


618 


Zo 


fl77 
oZZ 




1110 

X X X\J 


1410 


1122 


428 


191 


929 


Zo 


oZZ 


^Ifl 

OlO 


711 

/ xD 


1205 


617 


312 


20! 


929 


oZZ 


7fl 

Zo 


711 

1 XJ 


617 

\JX / 


312 


618 


7 


211 


929 


1 


71 1 


R77 


28 


1305 


312 


627 


221 


929 


1 




1Q 


713 

/ XJ 


629 


1213 


1426 


231 


19 


n 
1 


1711 
IZl J 


110^ 

1 JU^ 


029 


629 


1227 


801 


2A\ 


IV 


101 ^ 
IZIJ 


1777 
IZZ/ 


617 


14 

X" 


1305 


7 


629 


251 


DlZ 


IZZ/ 


1Q 


1213 

x^xJ 


14 


1321 


1029 


1305 


261 


DlZ 


IZZ/ 


1A 


102Q 


1213 

xs*x»^ 


1321 


19 


729 


271 


olZ 




1777 
IZZ/ 


77Q 


1029 


14 


1321 


1213 


281 


908 


77Q 
/Z9 


107Q 


612 


1227 

X^^ 1 


14 


301 


1321 


291 


908 


729 


1029 


301 


1019 


1021 


612 


12?7 


301 


908 


1416 


729 


301 


1019 


1021 


1029 


616 


311 


1416 


908 


1019 


301 


1021 


729 


616 


115 


321 


1416 


1019 


301 


1021 


908 


616 


115 


1414 


331 


1416 


1019 


616 


301 


1021 


115 


1414 


921 


341 


1416 


1019 


616 


921 


115 


1414 


301 


1021 


351 


1416 


921 


1019 


616 


1414 


115 


1411 


1018 


361 


1416 


921 


1411 


1414 


616 


1019 


115 


1018 



2.4. VERIFY INFOTABLE 

Verification consists of checking to see that all of the entries in the infot 
able also exist in the subtest list of questions. If no question actuaUy exists 



B-47 ^ 0\) 



the Test Administration program will be unable to select a question, and the 
svstem will fail. The verify option also creates, a second table. This second 
infotable is the one actually used by the Test Administration program. It con- 
tains the directory locations of the questions so that no search is required to 
find a question once it has been selected. 



0 ^ MODIFY I NFOTABLE 

This option allows a user to riake a change in an individual entry of the 
infotable. A picture repiesenting the infotable is displayed as follows: 



Test: 



Row: 

Column:^ 
Value: 




INSTRUCTIONS 

Use -> and < - to move 
horizontally in infotable 

Use <up arrow> and 
<down arrow> to move 
vertically in infotable 

To change a value in the 
table, go to the location 
you wish to change, Press 
'M", enter the new value 
then press < RET> . 

Press < ESC> to quit 
without updating. 

Press < CONTROL-C> to quit 
and update 



Moving the cursor selects an item in the table, which ^^J^ien be modified. 
After an infotable has been modified, the program branches to the venfjT 
option (see section 2.4) automatically. 



2 6. FIND ITFMS IN INFOTABLE 

This option aUoWs three basic types of searches to be conducted in the 
infotable. The user can search for a single item and. if the item is m the 
infotable, its location will be output. Alternatively, all of the locations of an 
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item can be found and printed out. The third option allows a user to Ust the 
entire* data base of a subtest's item code numbers broken into two categories: 
those that are in the infotable, and those that are not. This last option is 
important. Th^ere are often more than a hundred questions in the data base, 
and if some of them are included in the infotable (even though their parame- 
ters indicate they are not good enough), they just take up extra space and 
should be removed. 



FIND ITEMS MENU 
Select one of the following options by entering its number. 
1. QUIT 

2 FIND A SINGLE ITEM IN INFOTABLE 

3 LIST ALL OCCURRENCES OF AN ITEM TO SCREEN 
4' LIST ALL OCCURRENCES OF AN ITEM TO PRINTER 
5 LIST ALL UNUSED ITEMS TO SCREEN 

6. LIST ALL UNUSED ITEMS TO PRINTER 

Enter choice # : 



2.6.1. QUIT 

Selecting this option in the Find Items menu will cause a branch back to 
the Infoable Manager menu. 



2.62. FIND A SINGLE ITEM IN INFOTABLE 

This option allows the user to Iccatc-the first position (row and column) 
in the infotable of any item by entering its item code number. The screen 
prompts and the output are similar to the following diagrams: 



Item number you wish to find : 2 
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ITEM : 2 ROW : 13 COLUMN : 7 

Do you want the next location ? y 

ITEM : 2 ROW : 11 COLUMN : 8 

Do you want the next location ? n 

Do you want to find a different item ? n 



The program searches through the first column, rows 1 to 36, then column 
2 and so on until the item is found. After the first location has been found 
the remaining locations of that item can be found sequentially if desired. ' If 
an item does not exist in the infotable, a message will be displayed to indicate 
its ommission. 

2.63.4. LIST ALL OCCURRENCES OF AN ITEM 

This option allows the user to get a list the locations (row and column) of 
a particular item by entering its item code number. After the computer 
prompts, the output is similar to the following: 



Subtest : Word Knowledge 






Locations in infotable of item : 2 






ROW COL ROW COL ROW COL 
13 7 11 8 14 8 
15 13 9 16 


ROW 

10 


COL 
12 


No more locations of item 2 






Do you want to find a different item ? n 








2.6.5.6. LIST ALL UNUSED ITEMS 

This option separates the data base for this subtest into two groups: items 
that are in the infotable, and those that are not. The program searches the 
infotable for the first occurrence of each item in the data base. When found, 
the item goes into a list of items that are 'used,' that is, they have the 



10. 



•a 




Gettlsjg the items from file.... 



Number of items In file : 70 



Sorting items .... 



Be patient, I have to compare each of these 70 items 
to the infotable 



List of items found in infotable for : Word Knowledge 



2 5 10 15 17 20 25 27 

122 124 125 126 210 222 223 313 

327 329 401 402 406 408 410 411 

426 427 430 507 510 515 521 522 

604 606 609 615 616 620 628 703 

717 718 720 



List of items not used in : Word Knowledge 

4 11 12 29 im 2C'9 216 224 

409 413 416 421 422 501 508 513 

529 608 611 613 618 622 623 624 

713 715 719 



2.7. ANALYZF INFOTABLE ROWS 
This option allows the user to exat 
list the data to the screen, printer, or 
displayed, as in the following: 
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LIST OF SUBTESTS 
c 

1. Arithmetic Reasoning 3. Word knowledge 

2. Numerical Operations 4. General Science 

INSTRUCTIONS : Enter choice #, then press <RET> 
To escape, press 0, then < RET> 

Analyze rows for which subtest? 



A subtest is selected by entering its corresponding number. The options avail- 
able for listing row data are shown: 



SELECT OUTPUT MENU 
Select one of the following options by entering its number. 

1. QUIT 

2. LIST ALL ROW DATA 

3 LIST ONLY THE SUM OF EACH ROW 



Select choice # : 



2.7.1. QUIT 

Selecting this option from the Select Output menu will cause the program 
to branch back to the Infotable Manager menu. 

2.7.2. LIST ALL ROW DATA 

This option will prompt the user for the number of columns in each row 
to be listed. The program will list up to 20 columns. The row data are then 
displayed in a table under these entries: the column number, the item code 
number from the infotable. and the calculated infovalue. After each column, 
a new sum for theta is also displayed. 



2.73. LIST ONLY THE SUM OF EACH ROW 

This option will first prompt the user for the number of infovalues to be 
calculated for each row. Only the final sums of each row will be displayed; 
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individual item codes and infovalues are not shown. Once the number 
infovalues per row is selected, the Select Output menu will be revised 
appear as follows: 

— - y 

SELECT OUTPUT MENU 
Select one of the following procedures by entering its number. 



1. QUIT 

2. LIST RQW DATA TO SCREEN 

3. LIST ROW DATA TO PRINTER 

4. LIST ROW DATA TO TEXT FILE 



Enter choice # : 



2.73.1 QUIT 

This option in the revised Select Output menu will cause the program to 
branch to the Strategy Data Base menu. 

2.73.23.4 LIST ROW DATA 

Selecting one of these options will list the calculated values of theta to a 
printer, screen, or a text file. A partial sample of the output for the selection 
(4 out of 36 row values) of two infovalues follows: 



SUBTEST : General Science 




THETA : .225000e-H)0 


SUM : 


9.72199e-01 


THETA : -2.12500e+00 


SUM : 


L01658e-KX) 


THETA : .2.00000e+00 


SUM : 


1.03010e+00 


THETA : .1.87500e+00 


SUM : 


L02926e+00 



J n 
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SUBTEST : Word Knowledge 
Theta : -l£7700e+00 

Col Item# Infovalue Col Item# Infovalue Col Item# Infovalue 
1 1209 1.1266031 2 521 0.8547747 3 1012 0.8057737 
Sum for THETA = -1.87700e-K)0 : 2.78715eO0 
Press < retum> to continue 



After the row data have been listed to a device, the program will branch 
to the Graph menu. 



GRAPH MENU 
Select one of the following options by entering its number. 

1. NO GRAPH 

2. DISPLAY GRAPH ON SCREEN 

3. DISPLAY GRAPH ON PRINTER 
I 4. WRITE GRAPH OUT TO FILE 

i 

Enter choice # : 



2.13.(23AU^O GRAPH 

This selection will cause the program to branch back to the InfotaMe 
Manager menu. 

2.13(234^,23 DISPLAY GRAPH ON PRIN TER OR SCREEN 

A histogram of the sum of the chosen infovalues is listed to the screen or 
printer. A partial sample follows: 
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SUBTEST I General Science — 

sun OF ITEn Iftf^ORnATION VALUES OF BEST 2 ITEttS 



TFCTA sun 10 28 38 

1 1 1- 



-2.2S8 
-2.12S 
-2.880 
-1.875 
-i.758 
-1.625 
-1.588 
-1.375 
-1.258 
-1.125 
-1.808 
-8.87^^ 
-8.758 
-8.625 
-8.588 
-8.375 
-8.258 
-8.125 
8.8 
8.125 
8.258 
8.375 
8.588 
8.625 
8.758 



8.972 
1.817 
1.838 
1.029 
1.158 
1.331 
1.661 
2.886 
2.445 
2.673 
2.738 
2.631 
2.691 
3.457 
4.184 
4,^26 
3.898 
3.243 
3.377 
4.816 
4.G>89 
4.526 
4.859 
4.859 
4.748 



48 

— I- 



58 

— I- 



18 



28 



38 



— X - 
48 
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2.73(23,41.4 WRITE GRAPH OUT TO FILE 

This option writes the graph to a file; if no file name is given, the pro- 
gram will save STRAT-INFO.TEXT. Upon completion of any of the Graph 
menu options, the program will branc!. back to the Infotable Manager menu. 
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SECTION 7 
GRAPHICS EDITOR PROGRAM 
(MENU OPTION 7) 



The Graohics Editor program allows the computer to create pictures that 
can J^ saveS'a^ subtest quesHons. Available options include certain editing 
Sutures such as drawing polygons, allowing characters in graphics, hne draw- 
^« Md ^aphics compression routines. The graphics editor may be run by 
Xt^g option 7 in the CAT Pro.iect menu or by directly executing 
"CATDATAKjMGR.' See figure below: 



GRAPHICS MANAGER LIST OF SUBTESTS [im] 

1 Arithmetic Reasoning 3. Word Knowledge 
2. Numerical Operations 4. General Science 



INSTRUCTIONS : Enter choice #, then press < RET> 
To escape, press 0, then < RET> . 

Edit graphics for which subtest ? : 



Th« user selects a subtest for graphics editing by pressing the number 
„ext?o th ubtest If the user preVs '(T to quit the program con roUs 
nexi lo luc proiect menu. If a subtest is selectei, then the 

r^rttu. " .he ^aphul':-^^^^^^^^ T.. screen is «rs. Cared and .hen 

appears as follows: 



SUBTEST : 
Slow cursor 

< keypad #'s diiaw> 

< arrows to move> 



Fast cursor Draw 
Polygon Home 
Characters Erase 



Write file New 
Read file Krunch 
Line Quit 
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Because graphics pictures are done in inverse, the screen will appear 
white The bottom four lines of the screen give information about the subtest 
being used and the available options for graphics editing. Some of these are 
described in the following list: 

SLOW CURSOR: Pressing 'S' will set the pixel cursor to normal speed. 
The arrows that move the pixel cursor wiU move one pixel at a time. 

< KEYPAD #'S DRAW> : Pressing any of the numeric keys will plot a 
point or erase a point depending upon whether the user is in draw mode or 
erase mode The keypad numbers move in the following directions: 1-bW, 2- 
-S, 3--SE, 4~W, 5-current location, 6~E, 7-NW, 8-N, and 9--NE. 

< ARROWS TO MOVE>: Pressing any of the four arrows: up, down, 
left, and right, will move the pixel cursor in that direction without plotting or 
erasing a point. * 

FAST CURSOR: Pressing 'P will set the pixel cursor to fast speed, 
which is useful to move across the graphics screen to get to a desired location. 
The pixel cursor will move eight pixels with one press of the arrow key. 

POLYGON: Pressing a will let the user draw polygons of various sizes 
and shapes. The pixel cursor must be moved to the location where the^ttom 
of the polygon is desired before this option is selected. Af tr r pressing the 
user is asked : " What size polygon ? ' ' 

This input will set the number of pixels per side of the polygon. Typical 
input ranges from 4 to 20. It is best to experiment with this option first to get 
a feel for relative polygon sizes with relation to input. Next the user is asked . 
' How many sides ? ' 

This input will set the number of sides in the geometric figure. This 
number must be 4 or larger. 4 will draw a square and large ""^^e" wi 
approximate circles. After this input, the polygon is drawn and the user is 
put back into graphics editing. 

CHARACTERS: Pressing 'C will put you into the character mode for 
the graphics editor. The character cursor is put in the lower left comer and 
characters may be entered onto the graphics screen. Th^ airo^ °iove he 
character cursor. To leave the character mode, press <ESCAPE> and the 
pixel cursor will be put back in the lower left comer. 

DRAW- Pressing T)' will set the numeric keys in the draw mode. They 
will plot a pixel in the following directions corresponding to the following 
keys: 1~SW, 2--S, 3--SE, 4-W, 5-current location, 6-E, 7-NW, 8-N, and y- 

HOME- Pressing an 'H' will move the pixel to the lower-left corner of 
the graphics screen. This option is useful when you have no idea where you 
are on the graphics screen and you want to go to some reference pomt. 

ERASE: Pressing "E' will put the numeric keypad in the erase mode. 
"E" will erase whatever lies in the path of the pixel cursor. 
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WRITE FILE: This option writes whatever is on the graphics screen to 
a graphics file as a subtest question, or a subtest sample question, or to a file 
name specified by the user. The following menu is given: 



WRITE GRAPHICS MENU 
Select one of the foffowing options by entering its number. 
1. QUIT 

2 WRITE OUT AS SUBTEST QUESTION 

3. WRITE OUT AS SUBTEST SAMPLE QUESTION 

4. WRITE TO SPECIFIED FILENAME 

Enter choice # : 



1. QUIT 

This option terminates the Write Graphics menu and returns the u 
the graphics editor. 



2 WRITE O^ ^T^ SUBTEST QUESTION 

This option writes the current state of the graphics screen to a fotofile in 
the appropriate subdirectory on the volume CATFOTO. A file name 
corresponding to a name expected by Test Administration is automatically 
created for the fotofile. 

3. WRITE OUT AS SUBTEST SAIvlPLE QUESTION 

This option writes the current state of the graphics screen to a fotofile in 
the appropriate subdirectory on the volume CATFOTO. A file name 
corresponding to a name expected by T^st Administration is automatically 
created for the foto file. 
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4 WRITE TO SPECIFIED FILENAME 

This option asks the user for a specific file name in which to save the 
graphics screen. The picture is saved as a fotofile. This option is "^eful for 
Sving pictures that are not necessarily test questions, such as the Test 
Administration session header CATPICPOTO, which is a picture of a leopard 
leaping over a computer. 
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READ FILE: Pressing an 'R' will read a graphics file from the volume 
CATFOTO or some other specified volume. A menu appears as follows: 



READ GRAPHICS MENU 
Select one of the following options by entering its number. 

1. QUIT 

2. READ SUBTEST QUESTION 

3. READ SUBTEST SAMPLE QUESTION 

4. READ GRAPHICS FROM FILENAME 

Enter choice # : 



1. QUIT 

This option terminates the Read Graphics menu and returns the user to 
the graphics editor. 

2. READ SUBTEST QUESTION 

This option reads a fotofile or compressed graphics file from the volume 
CATFOTO and displays it on the graphics screen. First the item code of the 
question is requested. The procedure will look for a fotofile on the appropri- 
ate CATFOTO subdirectory and, if it does not exist, wUl look for a 
compressed graphics file. If it cannot find this either, it displays an error mes- 
sage. The picture displayed on the screen can be edited. 

3 READ SUBTEST SAMP LE QUESTION 

This option performs the same function as reading a subtest question, 
except that the subtest sample question number is requested mstead of the 
question item code. 

4 READ GRAPHICS FROM FILENAME 

This option asks the user for a specific file name to load the graphics file 
from. If it does not exist, an error message is displayed; otherwise the picture 
is put on the screen and editing is allowed. 

LINE- Pressing T' wiU draw a straight line from the current pixel cursor 
location to the last point plotted on the graphics screen. 

NEW- Pressing "TS' will clear the graphics screen so that the user can 
start over." Tl s option is used when the --"^^Y'^]-^'^ ^ 
First the user is asked: 'Start new graphics screen? Y/N .. U Y is pressea. 
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the entire graphics screen will be cleared. If "N' is selected, the user is 
returned to the graphics editor as if nothing had happened. 

KRUNCH- Pressing 'K' wUl write the current contents of the graphics 
screen to a graphics data file that is typically four blocks in size. It is used in 
place of fotofiles for Test Administration if the response time (time to 
display) is quick enough. The following menu is first given: 



KRUNCH GRAPHICS MENU 
Select one of the following options by entering its number. 
1. QUIT 

2 KRUNCH AS SUBTEST QUESTION 

3. KRUNCH AS SUBTEST SAMPLE QUESTION 

4. KRUNCH TO SPECIFIED FILENAME 

Enter choice # : 



1. QUIT 

This option terminates the Krunch Graphics menu and returns the user to 
the graphics editor. 

2 KRUNCH AS SUBTEST QUESTION 

This option sets the file name for the compressed graphics file to be writ- 
ten to the appropriate subdirectory on the volume CATDATA. First, the 
question item code is requested. If a compressed file exists already for the 
question, the computer will ask if the user wishes to destroy the old file. 

\ KRUNCH AS SUBTEST SAMPLE QUESTION 

This option performs the same function as krunching a subtest question 
except that the subtest sample question number is requested mstead of the 
question item code. 

4. KRUNCH TO SPECIFIED FILENAME 

This option asks the user for a specified file name for the ^aphics file. 
After the user has chosen where to send the graphics compressed file, borders 
must be set to dictate the area to be krunched. This option allows compress- 
ing of the entire graphics screen or some subportion of she screen. The screen 
will appear as follows: 
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some picture 



SET KRUNCH BORDERS 
Top Bottom Left Right 

< arrows move> Fast Cursor Slow Cursor 

< control - C to accept > 



Initially the borders are defaulted to the entire screen. To select a sub- 
portion of the screen to compress, move the pixel cursor to the location where 
you wish to set a margin, then press T, B, L, or R for the respective options 
of top, bottom, left, or right margin. If you make a mistake, just move the 
pixel cursor to the location you want and set the margin again. It is recom- 
mended that the margins be set to contain the picture in as little area as possi- 
ble to shorten the compression time. Compressing the entire screen will take 
approximately an hour, whereas selecting some subportion of the screen will 
greatly reduce the time. Whenever a margin is set, a line will be drawn to 
show where it is. The following is an illustration of a graphics screen with the 
top and bottom margins set: 



•••••••••••••••••• top margin 

some picture 



bottom margm 



SET KRUNCH BORDERS 
Top Bottom Left Right 

< arrows move> Fast Cursor Slow Cursor 

< control - C to accept > 



After all the desired margins are set, press < CONTROL-C> to accept 
the margins and begin krunching. Messages will appear at the bottom of the 
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screen describing what is happening to the graphics picture. These messages 
are 'Krunching fotofile," 'Coding horizontal lines,' 'Coding vertical lines. 
'Coding diagonal lines,' and 'Coding dots.' When the picture has been 
compressed, a message will appear at the bottom: 'Krunching is completed. 
Press < RET> to continue.' 

After pressing <RETURN>, characters can now be added to the 
compressed picture. The picture is displayed again and the user is put in a 
character editor as follows: 



some picture 

User can mix text here 
with the compressed 
picture. 



ERIC 



Enter krunched text. Use arrows to move cursor. 

< RET> next line ' 

< CTRL-C> to quit and save 



Due to the nature of the display of the character information, no part of 
the graphics picture may appear between characters on the same line of the 
screen Otherwise, that portion of the graphics picture will be erased. 

After entering the desired text, press <CONTROL-C>. The computer 
will indicate that the text is being entered. After the characters are written to 
the file the entire picture is displayed again, with the characters just entered. 
The us^r is prompted to press the <RETURN> key to continue. 

After this, the time required to display the picture is listed. This infor- 
mation is necessary to determine which pictures should be used as fotofiles 
and which as compressed graphics. The current criterion requires that the 
response time of a compressed graphics picture be 5 seconds or less; otherwise 
fotofile storage is used. 

After pressing <RETURN> again, the picture remains on the graphics 
screen, and the user is returned to the graphics editor with the mam options 
again. 

QUIT: Pressing 'CT exits the graphics editor and returns to the Graphics 
Manager list of subtests. 
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SECTIONS 
CAT SYSTEM DIAGNOSTICS PROGRAM 
(MENU OPTION 8) 



The System Diagnostics program was designed to debug and verify new 
and existing systems. It checks the infotables, graphics files, and item text of 
the subtests. It may be run by selecting the CAT System Diagnostics option 
from the CAT Project menu or by directly executing CATDATADJvIGR. 
The available options are described below: 



CAT SYSTEM DIAGNOSTIC MENU [1.05] 
Select one of the foUowing procedures by entering its number. 

1. QUIT 

2. CHECK INFOTABLES 

3. CHECK GRAPHICS FILES 

4 LOOK FOR DUPLICATE/SIMILAR QUESTIONS 



Enter choice # : 



1. QUIT 

This option terminates the CAT System Diagnostics program and then 
branches back to the CAT Project menu. 



2. CHECK INFOTABL ES 

Selecting this option will check the validity of data in the information 
tables for all the subtests and display the results as follows: 
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Subtest 



# of infotable errors 



Word Knowledge 
General Science 
Arithmetic Reasoning 
Numerical Operations 



0 
0 
0 

720 



Do you want to list the errors? Y/N : 



An additional option exists to list the errors by item codes to the console, 
file, or printer. For tests with no infotables, it is normal for 720 errors to 
occur. An error in an infotable means that the infotable is referencing a 
nonexistent question. The infotable must be regenerated or corrected and 
then reverified through the Stategy Data Manager. 



3. CHECK GRAPHICS FILES 

This option checks all the items for the subtests to verify that if the 
graphics flag is set, the appropriate graphics file exists on the volume CAT- 
FOTO in the correct subdirectory. The program displays the number of 
graphics files for a subtest and the errors that occurred. These errors indicate 
that a graphics flag is set with no corresponding fotofile or compressed graph- 
ics file in the system. Errors can be listed to the screen, printer, or text file. 



Subtest 



# or graphics foto errs krunch errs 



Word Knowledge 
General Science 
Arithmetic Reasoning 
Numerical Operations 



0 
4 
2 
0 



0 
0 
0 
0 



0 
0 
0 
0 



Do you want to list the errors ? Y/N : 
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4. LOOK FOR DUPLICATE/SIMILAR Q UESTIONS 

The CAT system duplicate question search procedure scans through a 
specified subtest and creates a list of questions that may be identical or sirai 
lar It extracts a given number of key words (the longest words, the number 
specified by the user), compares the key words to the key words of other ques- 
tions, and notes the number of matches that occur. SimUar and identical 
questions will have a greater number of matching key words. 

Three bits of information are required by the program : 

1. THE SUBTEST TO SCAN. A list of subtests is presented and the 
user specifies the subtest to search for duplicate or similar questions. 

2 NUMBER OF KEYS TO EXTRACT. The program allows a maximum 
of ten key words to be extracted per question. The user adjusts the level of 
analysis by specifying how many key words to get. 

3 MINIMUM CRITERION FOR MATCH. The user is requested to 
specify the number of key words that must match before a question is con- 
sidered to be similar to another. 

For large subtests (more than 150 questions), the program will require 
about 40 minutes to execute. This time will vary according to the number of 
key words to extract and the minimum criterion. Smaller values for these use 
sliehtly less time. (Note: Smaller values of the minimum critenon may result in 
finding too many matches on insignificant key words, which may cause a stack 
overflow. If stack overflow occurs, one should raise the minimum criterion.) 

When the text scanning is complete, the program will list question pairs 
that are similar, based on how many key words matched. The user has the 
option of sending this information to the screen, printer, or a text file at this 
Doint The output consists of item code pairs of similar questions. With these 
item codes, the user can also output the text of the possible similar questions. 
The screen output for the search procedure wUl be similar to the following 
example: 



RECOMMENDED VALUES 

(# keywords to extract) 
c.Kt^ Level of Analysis Minimum Criterion 


Word Knowledge 


8 


5 


General Science 


10 


6 


Arithmetic Reasoning 


10 


6 


Mathematics Knowledge 


8 


5 


Paragraph Comprehension 


10 


6 


ALL Numerical Operations n/a 


n/a 


PC2 


10 


6 


Automotive Information 


10 


6 


Electronics Information 


10 


6 


ALL Coding Speed 


n/a 


n/a 


Shop Information 


10 


6 


MC2 


n/a 


n/a 


AR2 


10 


6 


EI2 


10 


6 
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SECTION 9 

ON-LINE USER DOCUMENTATION PROGRAM 
(MENU OPTION 9) 



The User Documentation program provides access to the documentation 
that is stored on the Corvus disk. These documentation files can be viewed at 
a terminal or listed to a printer. Once the USERDOC option has been 
selected from the main progtam menu, a brief description of the program is 
displayed on the terminal screen. The alpha lock key should be depressed 
when running this program. A beU sounds if an incorrect key is pressed when 
selecting menu options. Note: To use this option, the user must have a 20- 
megabyte Corvus disk drive. 



USERDOC OPTION 

This program provides the user with the option of having 
documentation files displayed at the terminal or Usted 
to a printer. The text of a file appearing on the terminal 
wiU be displayed only 20 lines at a time. The user can 
escape the viewing option or print the text of the file. 
After each request is completed the program wUl return 
to a main options menu. 



Press the < return> key to continue the program : 



After the user presses the return key, the USERDOC Main menu will 
appear, offering five options. One exits the program, and wiother prints a 
hard copy of the complete documentation file directory. Of the remainmg 
three options, only one. Display Documentation Directory, provides the user 
with the names of the documentation files. The remaining two options assume 
that the user knows the necessary file name. Unless a specific file is to be 
examined, it is recommended that option 2, Display Documentation Directory, 
be used. 
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USERDOC MAIN MENU 



Select one of the options by entering its number 



1. QUIT 

2. DISPLAY DOCUMENTATION DIRECTORY 

3 DISPLAY A PRESELECTED FILE ON SCREEN 

4. PRINT COMPLETE DOCUMENTATION SUBDIRECTORY 

5. PRINT A PRESELECTED FILE 



Enter Item Choice # : 



1. QUIT 

Selecting this option will cause the program to exit the USERDOC pro- 
gram and branch back to the CAT Project menu. 

2. DISPLAY DOCUMENTATION DIRECTORY 

This option will first display a listing of the subdirectory headings avail- 
able to the user. Once a subdirectory has been chosen, the files in the sub- 
directory are displayed as in the list that follows. The user may now chose to 
view a file in the subdirectory, print a single file, or have a whole subdirectory 
printed. Once this routine has completed the requested option, it automati- 
cally branches back to the Userdoc Main menu. 
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PRIMARY DIRECTORY FILES 



Select desired subdirectory by entering its letter. 

A. FEATURES 

B. REQUIREMENTS 

C. PROGRAM DESCRIPTION 

D. PROJECT STRUCTURE 

E. FILE STRUCTURE 

F. USER DOCUMENTATION 

G. ADMINISTE^G A TEST 

H. SYSTEM PARAMETER MANAGEMENT 

I. SYSTEM/rrEMPOOL MANAGEMEOT 
J. EXAMINEE MANAGEMENT 

K. STRATEGY DATA MANAGEMENT 
L. GRAPfflCS MANAGER 

PRESS THE < ESO KEY TO RETURN TO THE MAIN MENU 
Enter Item Choice letter : 



The only way to exit the Primary Directory Files menu without having 
the computer perform any additional options is to press fihe <ESCAPE> 
key. Pressing the leiier 'A* will cause the screen to appear as follows: 



The Subdirectory FEATURES contains 5 Files 

A. ) QUIT 

B. ) /DOOFEATURES/Al 

C. ) /DOC/FEATURES/A2 

D. ) /DOC/FEATURES/ A3 

E. ) /DOC/FEATURES/A4 

F. ) /DOOFEATURES/AS 

Enter Item Choice Letter : 
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If option "A' is chosen, the program branches back to the USERDOC 
Main menu. Once a documentation file is chosen, it is scroUcd on the terminal 
20 lines at a time. If item letter "B" had been selected, the terminal would 
appear as follows: 



FILENAME : /DOC/FEATURES/A.l.TEXT 

PRESS THE < YES> KEY TO PRINT A FILE 

PRESS THE <: NO> KEY T&VIEW THE FILE 

PRESS THE <ESC> KEY TO EXIT THIS PROCEDURE 



Pressing the escape key from this display wUl cause the program to 
branch to the USERDOC Main menu. Pressing the "NO' key will start scrol- 
ling the text of the selected file on the screen, as shown in the following exam- 
ple: • 



CURRENTLY VIEWING: /DOC/FEATURES/Al.TEXT 



MINIMAL REQUIREMENTS FOR A CAT SYSTEM 
(Dewitt and Weiss, 1974) 

1. Select a test item from an item pool following a 
predetermined set of instructions. 

2. Present the item on a CRT or other display unit. 

3. Accept a response. 

4. Check response for validity and compatibility with the 
instructional sequence. 

5. Determine whether the response is correct or incorrect. 

6. Calculate the response latency (time required to answer 
the question). 

TO CONTINUE VIEWING PRESS < RET> ELSE PRESS < ESO 
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Pressing the <RETURN> key will continue the scrolling. If the 
< ESCAPE> key is pressed, the program will branch back to the USERDOC 
Main menu. When the end of the file is reached, a prompt is displayed at the 
bottom of the screen which says TO CONTINUE PRESS <RETURN> .- 
When the <RETURN> key is pressed, the program branches to th: Vbt^K- 
DOC Main menu. 

Pressing the 'YES" key will aUow the option of printing the file or its sub- 
directory. The option of printing a subdirectory is very useful because each 
file is only a 64-line page of the multipage subdirectory, and in most 
instances, the whole subdirectory will probably need to be prmted for con- 
tinuity of understanding. Pressing the -YES" key brings up the followmg 
screen : 



Press the <return> key to have DOOFEATURES/A.ITEXT printed 
Press the < ye8> key to print the subdirectory 



The program will branch back to the USERDOC Main menu once the desired 
print option is completed. 

3. DISPLAY A PRESELECTED FILE ON SCREEN 
Selecting this option displays the following screen: 



PLEASE ENTER FILE YOU WISH TO VIEW 
FILENAME : 



If the user knows the pathname of a particular documentation file, this 
option allows the subdirectory menus to be bypassed and the file to be 
immediately displayed. The program checks for a volume directory prefix 
(/DOC/) and a ".TEXT* suffix on the requested file name. If any of these are 
missing. 'and if the subdirectory name and file name are still correct the pro- 
eram wUl concatenate them to the file name and then display the file on the 
termisral. If an incorrect file name is entered, the following error message is 
displayed for about 10 seconds: 
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INCORRECT FILENAME 



The program branches back to the USERDOC Main menu after an input 
error is detected or the user completes viewing a file. 

The text of the chosen file will scroll on the screen. Pressing the 
<ESCAPE> key will return th<f user to the USERDOC Main menu. 

A PRINT COMPLETE DOC UMENTATION SIJBDI^CTORY 

This option will list all the documentation files to a printer, "eating a 
hard copy of the CAT system documentation. The program first double- 
checks with the user to be sure that the whole catalog is to be printed: 



ARE YOU SURE YOU WANT ALL 130 PAGES PRINTED? 
Press the <ye8> key to continue, the <no> key to exit : 



Once the program begins printing the complete documentation files. 
Dressing any key on the keyboard will terminate the operation and return the 
proiTm to the USERDOC Main menu. The file names being printed are 
listed under the banner message as they are completed: 



ENTIRE DOCUMENTATION CATALOG BEING PRINTED * 
Pressing any key on the keyboard will terminate this process * 



/DOC/FEATURES/ AO.TEXT 
/DOC/FEATURES/ Al TEXT 
/DOC/FEATURES/ A2.TEXT 



/DOC/D.GMGR/L9.TEXT 



5 PRINT A PRESELECTED FILE 

This option wUl Ust to a printer the contents of a single documentation 
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file The correct file name must be entered at the prompt, or an error message 
will appear for 10 seconds, and the program will branch back to the USER- 
DOC Main menu. 



Enter filename to be printed 



Enter filename to be printed : xxxxxxx 
•••••• INCORRECT FILENAME 



The program automatically checks for a correct '/DOC/' prefix and '.TEXT 
suffix on the file name and supplies them if the file and subdirectory names 
are correct. When the file has been listed to the printer, the program will 
branch back to the USERDOC Main menu. 
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SECTION 10 
GRAPHICS INFORMATION 



This section describes the current state of the graphics files on the volume 
CATFOTO. It relccts the data stored for each question. If the graphics flag 
is set the graphics information for the questior\ is displayed. Many questions 
have 'graphics files on the volume, but the flag is not set to use these graphics. 
Also, many graphic files exist on the volume without a question entered into 
the data base. 

The information here applies only to graphics for questions with the flags 
set. These questions expect graphics during the test administration. 



Subtest : General Science 
Volume : /CATFOTO/BDIR 

item code filename file type display time (sec) 

703 gbq703ioto fotofile 4 

919 gb919jdata compressed 2 

1012 gbl012xiata compressed 3 

1129 gbqll29ioto fotofile 4 



Subtest : Arithmetic Reasoning 
Volume : /CATFOTO/CDIR 

item code file name file type display time (sec) 

211 gc211.data compressed 5 

301 gc301.data compressed 4 



Subtest : Mathematics Knowledge 
Volume : /CATFOTO/DDIR 



item code file name file type display time (sec) 



23 
109 
115 
119 
123 
406 



gdq23ioto 

gdl09.data 

gdllS.data 

gdll9.data 

gdql23ioto 

gdq406ioto 



fotofile 

compressed 

compressed 

compressed 

fotofile 

fotofile 



4 
2 
3 
2 
4 
4 
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426 


gdq426loto 


516 


gd516roata 


703 


goq703joto 


818 


gdSloxiata 


826 


gdSZoxiata 


901 


gd901xiata 


923 


gdS>23xiata 


1014 


gdl014xiata 


1Z14 




1224 


gdl224x!ata 


1302 


gdql302ioto 


1323 


gdl323xlata 


1421 


gdl421xlata 



fotofile 

compressed 

fotofile 

compressed 

compressed 

compressed 

compressed 

compressed 

compressed 

compressed 

fotofile 

compressed 

compressed 



4 

2 
4 
3 
4 
4 
4 
3 
4 
5 
4 
3 
2 



Subtest : Automotive Information 
Volume : /CATFOTO/HDIR 



item code 


file name 


file type display time (sec) 


21 


ghq21ioto 


fotofile 4 


26 


ghq26ioto 


fotofile 4 


214 


ghq214ioto 


fotofile 4 


514 


ghq514ioto 


fotofile 4 


528 


ghq528ioto 


fotofile 4 


726 


g|i726xlata 


compressed 4 


1013 


g)il013.data 


compressed 4 


1026 


ghql026ioto 


fotofile 4 


1303 


ghql303ioto 


fotofile 4 


1322 


^ql322ioto 


fotofile 4 



Subtest : Mechanical Comprehension 
Volume : /CATFOTO/BDIR 



item code 


file name 


801 


giqSOlioto 


802 


giq802ioto 


803 


gi803xlata 


804 


gi804xlata 


805 


giq80Sioto 


806 


giq806ioto 


807 


giq807ioto 


808 


giSOSxlata 


809 


giq809ioto 



file type display time (sec) 



fotofile 

fotofile 

compressed 

compressed 

fotofile 

fotofile 

fotofile 

compressed 

fotofile 



5 
4 
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am 


oinRin fotn 
lU u 0 A v 


fotofile 


fill 
oil 


Hio A A kU a i«i 


comoressed 


oix 




comoressed 


oi^ 


mnRI? fotn 


fotofile 


Ol^ 


oinRUloto 


fotofile 


ol3 


Kl|] 0 1«J Jl V i V 


fotofile 


olO 


mnRiA fnfn 
KlClOlv JLVii/ 


fotofile 


olo 


mnRIR fnfn 

Kill OAO*»ViV 


fotofile 


olV 


mnRIQ fnfn 


fotofile 




mnROm fnfn 


fotofile 


Ml 


0iR91^afft 


coniDressed 




irinR22 foto 


fotofile 




irinR23^ofo 


fotofile 






fotofile 




ffiR^^afA 


compressed 


3^1 


oinOOl^oto 


fotofile 






fotofile 


oni 


ffin903^oto 


fotofile 




irinQ04^oto 


fotofile 




innOO^ fnfo 


fotofile 


VUO 




compressed 


Wo 


mnOnfi fnfn 


fotofile 




irinQOO^ofo 

lUU 7\/7 aA^/ ftV 


fotofile 


Qin 


mnQIO^ofo 


fotofile 


Oil 
7II 


mQII dafa 

IU7 A A aUOftCft 


compressed 


7IZ 


mn Q1? fofo 


fotofile 


All 

>13 


mnOI^ fnfn 
7 U •! ii/ 


fotofile 


Vl*t 


ainQIA fnfn 


fotofile 


V13 


AinQI^ fnfn 


fotofile 


7 10 


i9«nQ1^ fnfn 


fotofile 


017 

7l / 


iriQI? data 


compressed 


01R 
7 10 


mnQIR fofo 


fotofile 


VZl 


mO^I Hnfsi 
El7*l •Uaia 


comnresscd 




mQ99 dnf A 


comoressed 




inn 09^ fnfo 


fotofile 


OOA 

7Z4 


mnOTd fofo 

Kill 7*^»&\/iV 


fotofile 




m09^ dsif II 

giy^j»ijiiitt 


comnfcssed 


lUUl 


mlOOI^afa 

KIA kUaiCI 


comoressed 


lUUZ 


otlOO^ dnf A 


comoressed 




mn lOn^ fofo 

Kill X\j\MJmX\ft\9 


fotofile 


lUW 


minnA dsifn 
Kllvw^*UalB 


comoressed 


lliUD 


mn 1005 fofo 

Kill Avw*/«A VK^/ 


fotofile 


1006 


giql006ioto 


fotofile 


1007 


giql007ioto 


fotofile 


1008 


gil008.data 


compressed 


1009 


giql009ioto 


fotofile 


1010 


gil010.data 


compressed 
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inn 

lull 


ominil^ntn 


fotofile 


4 


lUl^ 


mnXMT. tntn 

Kl U JiL VI X ^ U i V/ 




4 


lUlo? 




fotofilc 


4 


iui*r 




fotofile 


4 


lUlO 


Din 1016 fotO 


fotofilc 


4 


1017 
lUl / 


crininiT^OtO 


fotofilc 


4 


lUlO 


9inini8^oto 


fotoflle 


4 


lUl jr 


crininiQ^oto 

lU U X\J Jl ^ V/ ft V/ 


fotofilc 


4 


1020 


giql020ioto 


fotofile 


4 


1021 


gil021.data 


compressed 


5 


1022 


giql022icio 


fotofile 


4 


1023 


gil0234iau 


compressed 


5 


1024 


giql024ioto 


fotofile 


4 


1025 


giql025ioto 


fotofile 


4 



Subtest : Electronics Information 
Volume : /CATFOTO/JDIR 



item code 


file name 


file type 


display time (sec) 


802 


gj802^ata 


compressed 


5 


904 


gjq904ioto 


fotofile 


4 


915 


gjq915ioto 


fotofile 


4 


1002 


gjql002ioto 


fotofile 


4 


lOOS 


gjlOOS^ata 


compressed 


2 


1007 


gjl007^ata 


compressed 


4 


1009 


gjqlOOTJoto 


fotofile 


4 



Subtest : MK2 

Volume : /CATFOTO/QDIR 



item code file name 
2022 gq2022x!ata 



file type display time (sec) 
compressed 4 



Subtest : Shop Information 
Volume : /CATFOTO/RDIR 



item code 



16 
112 
119 



file name 



file type display time (sec) 



grl6^ata 

grll2^ata 

grll9^ata 



compressed 
compressed 
compressed 



3 
4 

5 
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204 grq204ioto 

212 grq212ioto 

313 gr313^ata 

316 gr316^ata 

327 gr327Jata 

401 grq401ioto 

403 j^403Jata 

406 gr406Jata 

412 grq412ioto 

423 grq423ioto 

429 grq429ioto 

511 grSlUata 

522 gr522Jata 

523 grq523ioto 

524 gr524Jata 
527 gr527Jata 

608 no file 

609 grq609ioto 
622 no file 

801 grSOlJata 

814 grqSUioto 

818 grqSlSioto 

819 gr819.data 
912 grq912ioto 
924 grq924ioto 
929 gr929.data 

1016 grl016.data 

1023 grql023ioto 

1028 grql028ioto 

1103 grqll03ioto 

1106 grqll06ioto 

1121 grqll21ioto 

1127 grl 127 .data 

1224 grl224.data 
1303 grl303^ata 
1310 grl310.data 
1314 grl314.data 

1322 grql322.foto 

1323 grql323ioto 
1326 grl326.data 
1404 grql404ioto 
1411 grl411.data 
1523 grl523.data 



fotofile 

fotofile 

compressed 

compressed 

compressed 

fotofile 

compressed 

compressed 

fotofile 

fotofile 

fotofile 

compressed 

compressed 

fotofile 

compressed 

compressed 

fotofile 

compressed 

fotofile 

fotofile 

compressed 

fotofile 

fotofile 

compressed 

compressed 

fotofile 

fotofile 

fotofile 

fotofile 

fotofile 

compressed 

compressed 

compressed 

compressed 

compressed 

fotofile 

fotofile 

compressed 

fotofile 

compressed 

compressed 
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Subtest : MC2 

Volume : /CATFOTO/SDIR 



item code file name file type display time (sec) 
111 ggllLdata compressed 5 



Subtest : EI2 

Volume : /CATFOTO/UDIR 



item code 


file name 


file type 


display time (sec) 


741 


no file 






744 


Eu744.data 


compressed 


5 


752 


guq752ioto 


fotofile 


4 


762 


guq762ioto 


fotofile 


4 


769 


gu769.data 


compressed 


2 


773 


no file 






783 


gu783.data 


compressed 


4 


795 


no file 






803 


no file 






808 


guqSOSioto 


fotofile 


4 


812 


no file 






822 


gu822.data 


compressed 


5 


830 


no file 






848 


gu848.data 


compressed 


5 


851 


guqSSlioto 


fotofile 


4 


865 


no file 






866 


gu866.data 


compressed 


3 


871 


no file 






887 


gu887.data 


compressed 


2 


7103 


gu7103.data 


compressed 


4 


8105 


no file 
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SECTION 11 
MISCELLANEOUS ASSOCIATED PROGRAMS 
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The foUowing utUity program* play no direct role in the CAT system but 
were used to format the data files and maintain the system or were developed 
for experimental purposes. 

NEITHER OF THE TWO PROGRAMS THAT FOLLOW SHOm.D BE 
USED UNLESS ABSOLUTELY NECESSARY. THEY HAVE THE 
POTENTLU. TO RUIN YOUR SYSTEM. 

Program : CATFFORMAT.TEXT 
Volume : /TFILES/MISC J>IR 

Description: This program was used to initialize the format and size of 
all files in the CAT system. If it is used again inappropriately, it wiU destroy 
all existing data. 

Program : CATKRUNCH.TEXT 
Volume : /TFILES/MISC J>IR 

Description: No garbage coUcction exists for ASCU text in a question 
when the item is deleted or modified. All new text is added to the end of 
The file on volume QTEXT. If space runs out on QTEXT, this program may 
help rewrite the entire ASCH file into a smaUer size, elmimating the unused 
space. 

Additional experimental programs include : 

FTMGRTEXT exists on /TFILES/FTMGRDIR with its associated files. 
It is a floppy disk version of Test Data Base Management. J^jhc T.MGR pro- 
^am. there is an option that writes a subtest to a floppy. F.TMGR is the pro- 
gram that can read this floppy. 

PEXPJ^GR.TEXT exists on a floppy disk with its associated files. It is a 
floppy version of the Parameter Setup for the test administration. It will set 
up a file for a floppy version of the test administration program 

CATPl exists on a floppy disk with its associated files. It is a floppy ver- 
sion of the test administration program. It wQl load subtests from floppies 
instead ox the Corvus disk and will not handle graphics. 

CROSSREF.TEXT exists on a floppy disk with its associated files. It is a 
detailed cross-reference generator that gives information on variables: where 
thev were declared, what line they were referenced on, wid their type. It 
doesn't handle large programs well because of stack overflow. It wUl read 
''include'' files. 

These experimental programs may not be compatible with the current 
CAT system implementation- 
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